SlideShare a Scribd company logo
1 of 68
Download to read offline
We did it!!? 
There is place for QAs in Agile!? 
Michał Kujałowicz 
michal.kujalowicz@spartez.com
• Partner 
• Involved in development of core Atlassian products 
• Commercial, Open-Source add-ons, 
customizations 
• Developers, Product Managers, Designers, QAs, 
Agile Team Leads 
• Me: JIRA QA Team Lead
QA vs Tester 
NOT TODAY, 
THANKS!
My story 
2006 
! 
• My first real 
Agile Project 
• About it later 
• Heard about Agile in 2006 on 
ISTQB straining 
• First project - 2006 
• No one knew what to do 
• Testers in Agile? No 
experiences available 
• Short story 
2012 
2013 
! 
! 
• Quality 
Assistance
The fear 
2009 
Popularity 
Developer 
Testing Interdisciplinary Technical Skills
How Agile is your team? 
“There are now many teams that label themselves as 
‘agile’, but some agile teams are more agile than 
others”! 
! ! ! ! ! ! ! ! ! ! ! Stuart Reid “Are all pigs equal?” Testing Experience 2009
How Agile is your team? 
My take: 
• Team empowered to improve their process 
• Fast feedback and adaptation 
• Production ready increment as result of iteration 
• Everyone is responsible for the team’s output
My first “real” Agile project 
• Test Manager 
• Around 10 developers at the beginning, 3 testers 
• From time perspective - not good 
• No shared quality responsibility, bad fitting, 
technical debt 
• No experience, no enough thinking, no guidance
TOAST FOR QUALITY
TOAST for Quality 
• A model helping organise 
QA process inside Agile 
project 
• Refers to whole quality 
process - not only QAs 
T - Types and Techniques 
O - Organisation! 
A - Added value 
S - Skills ! 
T - Tracking
Types and Techniques - 
O - A - S - T 
• Which test types do you need to execute within 
your Agile process? 
• Which software characteristics you need to cover 
(performance, usability)? 
• What techniques will you use for those tests?
Types and Techniques - 
• Types: 
O - A - S - T 
• Functional tests, Performance, Load, Stress, Usability, … 
• Techniques: 
• Scripted testing, Automated tests, Exploratory testing 
• White-box, Grey-box, Black-box
Feature 
Story 
Story 
Feature 
… 
Task 
Release 
… Task 
… 
TO PRODUCTION 
but also Timing
Feature 
Story 
but also Timing 
RELEASE TESTING 
PRODUCT ! 
REGRESSION 
Story 
Feature 
… 
Task 
Release 
… Task 
… 
STORY TESTING 
FEATURE ! 
REGRESSION 
PRODUCT ! 
REGRESSION 
FEATURE TESTING 
PRODUCT ! 
REGRESSION
T - Organisation - A - S - T 
• How do you plan to organise testing activities? 
• Quality is the responsibility of the complete team! 
• What is the team setup (How many QAs? How 
many Developers)? 
• What is the QA role in testing activities?
T - O - Added Value - S - T 
• Where do we add value beyond testing? 
• Automation, Business Analysis, Acceptance 
Criteria, Customer Support, Customer Contact, 
Test Data, Test Environments?
T - O - A - Skills - T 
• What skills do we need in the team? 
• What do we need to do to fulfil needs? 
• Where can QAs specialise? 
• Are QAs technical enough?
T - O - A - S - Tracking 
• How do we estimate QA activities and verify those? 
• How do we measure the process? 
• How do we measure product quality? 
• How do we get inputs for retrospective? 
• …
PRACTICES
Types 
Types, Techniques, 
Timing 
• Which software characteristics are crucial for you? 
• Functionality, Usability, Scalability, …ility 
• Depends on your context 
KEEP! 
CALM! 
ITS 
NOT IN! 
SCOPE
Types, Techniques, 
Timing 
Agile Testing Quadrants 
“Agile Testing: A Practical Guide for Testers and Agile Teams” Lisa Crispin and Janet Gregory
Techniques 
Types, Techniques, 
Timing 
• Scripted, Exploratory, Ad-hoc, Automated 
• White-box, Grey-box, Black-box 
! 
• Agile moves onto Exploratory, White-Box and 
Automated
Exploratory 
Types, Techniques, 
Timing 
“Telling your exploratory story” Jon Bach, Agile 2010
SBTM 
Types, Techniques, 
Timing 
• Session Based Test Management 
• Charters 
• Sessions 
• Notes 
• Debriefing (PROOF)
SBTM 
Types, Techniques, 
Timing 
Organisation 
“Adding value in an agile context” ! 
by Henrik Andersson
SBTM 
Types, Techniques, 
Timing 
Organisation 
• Not only exp. testing technique but a whole 
organisational approach! 
• Every Testing activity is a Session (~90-minutes) 
• Estimate number of possible sessions for every 
iteration (3-4 sessions a day) 
• Fight on the Sprint planning to prioritise 
• Take metrics e.g. Sessions burndown chart
Types, Techniques, 
Timing 
A word about exploratory 
• We do not know how to describe the exploratory 
thinking 
• Considered as ‘playing around’ without any test 
documentation 
• Fight that! 
• Think about it before encouraging your organisation
Automation 
Types, Techniques, 
Timing 
UI 
Continuous 
Services 
Integration Unit Tests
Feature 
Story 
RELEASE TESTING 
PRODUCT ! 
REGRESSION 
Story 
Feature 
… 
Task 
Release 
… Task 
… 
STORY TESTING 
FEATURE ! 
REGRESSION 
PRODUCT ! 
REGRESSION 
FEATURE TESTING 
PRODUCT ! 
REGRESSION 
Types, Techniques, 
Timing 
Timing
Types, Techniques, 
Timing 
Timing 
• Think what you have and 
what you do not have! 
• The testing scope activities 
represent risks - not all risks 
must be covered with testing 
• … but they must be 
addressed!
Release every 2 weeks 
FEATURES STORIES 
Testing 
Release 2-3 times a year 
FEATURES STORIES 
Types, Techniques, 
Timing 
NO 
(Optional) Blitz Test 
STORY TESTING 
Autom. (CI) 
Autom. (CI) 
FEATURE ! 
REGRESSION 
PRODUCT ! 
REGRESSION 
FEATURE TESTING 
PRODUCT ! 
REGRESSION 
RELEASE TESTING 
PRODUCT ! 
REGRESSION 
Release 
Feature 
Story 
Autom. (CI) Autom. (CI) 
Manual exploratory tests! 
+ Automated tests
Teams 
Organisation 
• QA is part of the team (3-4 developers) 
• Main responsibility - testing (moving towards exp. 
testing) 
! 
• Other responsibilities = Added value 
• Everyone has ‘Developer’ role
• Tool usage: sub-task of every story, separate 
testing tasks 
• Part of the definition of done 
• SBTM 
Tasks 
Organisation
! 
Organisation 
Quality is everyones responsibility! 
• No satisfying answer 
• Sharing partly testing with developers (checking 
vs. testing) 
• Unit tests, TDD, Automated tests 
• My answer: Quality Assistance
Quality Assistance 
Organisation 
• 1 QA per 10 developers 
• Testing in hands of developers (both manual and 
automatic) 
• Teaches, mentors what and how to test, helps 
identifying most risk areas for testing 
• QA does not test - has time for process 
improvement, experimenting, bugs analysis, test 
tools
Quality Assistance 
Organisation 
• Quality is indeed everyones responsibility 
• Automated tests from scratch 
• Tech camp presentation: 
• http://www.slideshare.net/mkujalowicz/1x10-the-role- 
of-qa-engineer-in-jira 
• http://vimeo.com/86691004
Keys to succeed 
Added Value 
• The team must feel QA is mandatory element of the team 
and its every activity 
• Get the unique strengths and use them 
• support Product Owner to transfer customer needs onto 
backlog and acceptance criteria / automated tests 
• technical debt 
• test tooling and test coverage 
• …
Added Value 
• Visibility of QAs work! 
• “Yesterday testing, today 
testing” 
• Daily stand-ups 
• Interesting idea: 
• ‘Report on your 
product’s health’ by 
Henrik Andersson 
(http://tvfortesters.com/video/adding-value- 
in-an-agile-context-by-henrik-andersson/)
Added Value 
• TDD 
• ATDD 
• BDD 
• Specification by 
example 
• Not my cartoon :P - 
maybe yours? 
http://www.fanpop.com/clubs/dexters-laboratory/images/13130720/title/deedee-photo
Added Value 
• Teaching / mentoring 
• Test tooling, test coverage 
• Process improvement, bug analysis 
• Customer view 
• We are “linkers” and “sharers”
Skills
Technical skills 
Skills 
• Basics: 
• IDE, SCM situation, Reviews 
• White-box, Grey-box skills 
• Technologies 
• Further: 
• Depends on your project
Skills 
Technical skills 
• Comes out of your added values analysis 
• Test techniques, Data gathering, Test Tools 
• Sorry - no recipe here 
! 
• Go beyond what is on paper
Tracking 
What should we track? 
• QA Tasks tracking 
• Internal and External product quality 
• Dev speed, QA speed 
• Product health 
• Product usage
Tracking 
Do we do that? 
• Not much people sharing it 
• Create QA activities backlog and monitor its burn-down 
- SBTM and Test Sessions 
• Bugs and quality - we should have it covered - do 
we? In most projects - not trivial
Tracking 
• Story rejection rate 
• OD Incidents, Stable regressions 
• Rework time 
• SaaS delivery index = JBS * 0.5 + PBS * 0.5 + 
C2M * 20 + C2DEV * 10 + D8W * -10 + NI * 100
BUT…
… our projects are different 
• Products in production for several years - not build 
from scratch 
• Almost full manual regression when switching to 
Agile 
• No automation possible/no automation in place 
• Test documentation requirements 
• Dislocated teams
No automation 
Does not Scale
No automation 
“Agile Testing” Tito Linz, Testwarez 2014
No automation 
“Telling your exploratory story” Jon Bach, Agile 2010 
But we require test documentation!
Test documentation 
necessary 
• What is actually needed? 
What does one wants to 
achieve? 
• Does anyone read it at all? 
• Good exploratory testing 
charters 
• Find your own way!
No automation 
• You won’t win without experimenting and taking 
risks! 
• Application specialist - interesting idea 
• Going further: White-box QA
White-box QA 
• Pick the most technical person 
• Let her/him analyse the dependencies, how it 
works 
• Manual regression tests recommendations 
• Teach others how to do it
No automation != no work 
on automation
• Web Applications 
automation - easy 
• Desktop - mature 
• Mobile - growing but hard 
• Embedded - self-made 
! 
• Start with quick wins - e.g. 
Visual Regression
Multiple locations 
• Is it still Agile? 
• No unicorns here 
• Use the available tools, look for tools 
• Martin Fowler: “Using an Agile Software Process with 
Offshore Development”
WHAT DO WE MISS
What does it mean to be 
Agile QA 
Process & Product
Unexplainable expectation 
• QA must limit the 
speed, QA must hold 
development plans, 
QA must make sure 
we do not take risks
Product risks 
• What does it mean to leave this area untested? 
• What does it mean to leave this bug in release? 
• Gather data regarding customer usage
Process risks 
• Experiment around your process 
• Take a risk to have time on process improvement 
• Failure is also a success 
• Make sure you know what success means
Our story 
• QA Testing 
• Testing notes 
• DoTing 
• QA Demo 
• Dev as a QA
The train is leaving 
• Development specificity 
changes 
• QA specificity changes: 
• Analytics, Experiments, 
A/B Testing, Continuous 
Deployment 
• Explore new paths!
Summary 
• Think if you merit a TOAST? Not everything is 
required but it must be a conscious decision 
• QA work visibility 
• Think through your Regression test situation 
• Quality responsibility of the complete team - Quality 
Assistance 
• Take risks and experiment
Satisfaction! 
The fear 
2009 
Popularity 
Developer 
Testing 
Interdisciplinary Technical Skills
Thank you!
Images - credits 
• Żuraw in Gdańsk - by JM_GD - CC BY 2.0 
• 3D Growth Projections - by Chris Potter - CC BY 2.0 
• Architetto -- Donna casinista - by francesco_rollandin - CC BY 2.0 
• Toast - by Stiefen Schlingen - CC BY 2.0 
• Toasting Champagne - Waldo Jaquith - CC BY-SA 2.0 
• Thinking - by Wade M - CC BY-SA 2.0 
• Stadion Narodowy w Warszawie - by Artur Malinowski - CC BY 2.0 
• Thumbup - Pratheepps - CC0 1.0 
• Documentation - by Marta Pucciarelli - CC-BY-SA-3.0 
• Difficult - Sea Turtle - CC BY-NC-ND 2.0 
• Chemia Laboratorium Experyment - pixabay.com - CC0 1.0 
• Comic Daredevil Bello Nock - Chris Phutully - CC BY 2.0 
• Surprise major - by Achim Hering - CC-BY-SA-3.0 
• Train Left - SElefant - CC-BY-SA-3.0

More Related Content

What's hot

Agile2014 Report: As a Speaker and a Reporter of the latest Agile in the world
Agile2014 Report: As a Speaker and a Reporter of the latest Agile in the world  Agile2014 Report: As a Speaker and a Reporter of the latest Agile in the world
Agile2014 Report: As a Speaker and a Reporter of the latest Agile in the world Rakuten Group, Inc.
 
You Can't Always Get What You Want by Anna Heiermann
You Can't Always Get What You Want by Anna HeiermannYou Can't Always Get What You Want by Anna Heiermann
You Can't Always Get What You Want by Anna HeiermannQA or the Highway
 
How to Reboot your Agile Team - Ottawa 2016
How to Reboot your Agile Team - Ottawa 2016How to Reboot your Agile Team - Ottawa 2016
How to Reboot your Agile Team - Ottawa 2016Maurizio Mancini
 
ExpoQA 2017 testing_tools_in_the_ages_of_devops_and_agile
ExpoQA 2017 testing_tools_in_the_ages_of_devops_and_agileExpoQA 2017 testing_tools_in_the_ages_of_devops_and_agile
ExpoQA 2017 testing_tools_in_the_ages_of_devops_and_agileEduardo Riol
 
How to Reboot your Agile Team San Diego 2017
How to Reboot your Agile Team San Diego 2017How to Reboot your Agile Team San Diego 2017
How to Reboot your Agile Team San Diego 2017Maurizio Mancini
 
Agile scrum как не угробить ваш продукт простым инструментом, Артем Быковец
Agile scrum как не угробить ваш продукт простым инструментом, Артем БыковецAgile scrum как не угробить ваш продукт простым инструментом, Артем Быковец
Agile scrum как не угробить ваш продукт простым инструментом, Артем БыковецSigma Software
 
Wix.com Back-end Engineering Guild Manifesto
Wix.com Back-end Engineering Guild ManifestoWix.com Back-end Engineering Guild Manifesto
Wix.com Back-end Engineering Guild ManifestoAviran Mordo
 
Dev ops is more than CI+CD tools
Dev ops is more than CI+CD toolsDev ops is more than CI+CD tools
Dev ops is more than CI+CD toolsSudipta Lahiri
 
Technical Excellence Doesn't Just Happen--Igniting a Craftsmanship Culture
Technical Excellence Doesn't Just Happen--Igniting a Craftsmanship CultureTechnical Excellence Doesn't Just Happen--Igniting a Craftsmanship Culture
Technical Excellence Doesn't Just Happen--Igniting a Craftsmanship CultureAllison Pollard
 
How to Reboot Your Agile Team Agile 2017
How to Reboot Your Agile Team Agile 2017How to Reboot Your Agile Team Agile 2017
How to Reboot Your Agile Team Agile 2017Maurizio Mancini
 
Technical Excellence Doesn't Just Happen - AgileIndy 2016
Technical Excellence Doesn't Just Happen - AgileIndy 2016Technical Excellence Doesn't Just Happen - AgileIndy 2016
Technical Excellence Doesn't Just Happen - AgileIndy 2016Allison Pollard
 
Experience sharing-in-scrum
Experience sharing-in-scrumExperience sharing-in-scrum
Experience sharing-in-scrumJen-Chieh Ko
 
Explore Events of Scrum Framework
Explore Events of Scrum FrameworkExplore Events of Scrum Framework
Explore Events of Scrum FrameworkNaveen Kumar Singh
 
Pactical case of Atlassian Tools implementation
Pactical case of Atlassian Tools implementation Pactical case of Atlassian Tools implementation
Pactical case of Atlassian Tools implementation Yuriy Kudin
 
Quality Jam 2016 Product Roadmap
Quality Jam 2016 Product RoadmapQuality Jam 2016 Product Roadmap
Quality Jam 2016 Product RoadmapQASymphony
 

What's hot (20)

Agile2014 Report: As a Speaker and a Reporter of the latest Agile in the world
Agile2014 Report: As a Speaker and a Reporter of the latest Agile in the world  Agile2014 Report: As a Speaker and a Reporter of the latest Agile in the world
Agile2014 Report: As a Speaker and a Reporter of the latest Agile in the world
 
You Can't Always Get What You Want by Anna Heiermann
You Can't Always Get What You Want by Anna HeiermannYou Can't Always Get What You Want by Anna Heiermann
You Can't Always Get What You Want by Anna Heiermann
 
How to Reboot your Agile Team - Ottawa 2016
How to Reboot your Agile Team - Ottawa 2016How to Reboot your Agile Team - Ottawa 2016
How to Reboot your Agile Team - Ottawa 2016
 
ExpoQA 2017 testing_tools_in_the_ages_of_devops_and_agile
ExpoQA 2017 testing_tools_in_the_ages_of_devops_and_agileExpoQA 2017 testing_tools_in_the_ages_of_devops_and_agile
ExpoQA 2017 testing_tools_in_the_ages_of_devops_and_agile
 
What is Agile Testing
What is Agile TestingWhat is Agile Testing
What is Agile Testing
 
Agile Testing by ShriKant Vashishtha
Agile Testing by ShriKant VashishthaAgile Testing by ShriKant Vashishtha
Agile Testing by ShriKant Vashishtha
 
Agile tester 3.0
Agile tester 3.0Agile tester 3.0
Agile tester 3.0
 
How to Reboot your Agile Team San Diego 2017
How to Reboot your Agile Team San Diego 2017How to Reboot your Agile Team San Diego 2017
How to Reboot your Agile Team San Diego 2017
 
Agile scrum как не угробить ваш продукт простым инструментом, Артем Быковец
Agile scrum как не угробить ваш продукт простым инструментом, Артем БыковецAgile scrum как не угробить ваш продукт простым инструментом, Артем Быковец
Agile scrum как не угробить ваш продукт простым инструментом, Артем Быковец
 
Wix.com Back-end Engineering Guild Manifesto
Wix.com Back-end Engineering Guild ManifestoWix.com Back-end Engineering Guild Manifesto
Wix.com Back-end Engineering Guild Manifesto
 
Dev ops is more than CI+CD tools
Dev ops is more than CI+CD toolsDev ops is more than CI+CD tools
Dev ops is more than CI+CD tools
 
Technical Excellence Doesn't Just Happen--Igniting a Craftsmanship Culture
Technical Excellence Doesn't Just Happen--Igniting a Craftsmanship CultureTechnical Excellence Doesn't Just Happen--Igniting a Craftsmanship Culture
Technical Excellence Doesn't Just Happen--Igniting a Craftsmanship Culture
 
How to Reboot Your Agile Team Agile 2017
How to Reboot Your Agile Team Agile 2017How to Reboot Your Agile Team Agile 2017
How to Reboot Your Agile Team Agile 2017
 
Technical Excellence Doesn't Just Happen - AgileIndy 2016
Technical Excellence Doesn't Just Happen - AgileIndy 2016Technical Excellence Doesn't Just Happen - AgileIndy 2016
Technical Excellence Doesn't Just Happen - AgileIndy 2016
 
Experience sharing-in-scrum
Experience sharing-in-scrumExperience sharing-in-scrum
Experience sharing-in-scrum
 
Explore Events of Scrum Framework
Explore Events of Scrum FrameworkExplore Events of Scrum Framework
Explore Events of Scrum Framework
 
Leading agile teams
Leading agile teamsLeading agile teams
Leading agile teams
 
Agile ncr2016 ppt
Agile ncr2016 pptAgile ncr2016 ppt
Agile ncr2016 ppt
 
Pactical case of Atlassian Tools implementation
Pactical case of Atlassian Tools implementation Pactical case of Atlassian Tools implementation
Pactical case of Atlassian Tools implementation
 
Quality Jam 2016 Product Roadmap
Quality Jam 2016 Product RoadmapQuality Jam 2016 Product Roadmap
Quality Jam 2016 Product Roadmap
 

Viewers also liked

Writing better user stories
Writing better user storiesWriting better user stories
Writing better user storiesChris Urban
 
Story workshop writing better stories
Story workshop writing better storiesStory workshop writing better stories
Story workshop writing better storiesNimesh Soni
 
1×10 rola QA w tworzeniu Atlassian JIRA
 1×10 rola QA w tworzeniu Atlassian JIRA 1×10 rola QA w tworzeniu Atlassian JIRA
1×10 rola QA w tworzeniu Atlassian JIRA3camp
 
Better User Stories by Matteo Cavucci
Better User Stories by Matteo CavucciBetter User Stories by Matteo Cavucci
Better User Stories by Matteo CavucciBosnia Agile
 
Agile testing principles and practices - Anil Karade
Agile testing principles and practices - Anil KaradeAgile testing principles and practices - Anil Karade
Agile testing principles and practices - Anil KaradeIndicThreads
 

Viewers also liked (11)

Writing better user stories
Writing better user storiesWriting better user stories
Writing better user stories
 
Story workshop writing better stories
Story workshop writing better storiesStory workshop writing better stories
Story workshop writing better stories
 
1×10 rola QA w tworzeniu Atlassian JIRA
 1×10 rola QA w tworzeniu Atlassian JIRA 1×10 rola QA w tworzeniu Atlassian JIRA
1×10 rola QA w tworzeniu Atlassian JIRA
 
QA and scrum
QA and scrumQA and scrum
QA and scrum
 
ProductSavvy - Scrum and QA
ProductSavvy - Scrum and QAProductSavvy - Scrum and QA
ProductSavvy - Scrum and QA
 
Transition to agile
Transition to agileTransition to agile
Transition to agile
 
Better User Stories by Matteo Cavucci
Better User Stories by Matteo CavucciBetter User Stories by Matteo Cavucci
Better User Stories by Matteo Cavucci
 
Agile testing principles and practices - Anil Karade
Agile testing principles and practices - Anil KaradeAgile testing principles and practices - Anil Karade
Agile testing principles and practices - Anil Karade
 
How we measure quality of JIRA deployments to Cloud?
How we measure quality of JIRA deployments to Cloud?How we measure quality of JIRA deployments to Cloud?
How we measure quality of JIRA deployments to Cloud?
 
Quality is a Mindset
Quality is a MindsetQuality is a Mindset
Quality is a Mindset
 
How to write good user stories
How to write good user storiesHow to write good user stories
How to write good user stories
 

Similar to We did it!!? There is place for QAs in Agile!!?

Agile Way to First Iteration
Agile Way to First IterationAgile Way to First Iteration
Agile Way to First IterationMikalai Alimenkou
 
A New Model For Testing
A New Model For TestingA New Model For Testing
A New Model For TestingTEST Huddle
 
Project management for qa manager
Project management for qa managerProject management for qa manager
Project management for qa managergaoliang641
 
Agile Testing - What, why and how.
Agile Testing - What, why and how.Agile Testing - What, why and how.
Agile Testing - What, why and how.Asim Kazmi
 
Tester Challenges in Agile ?
Tester Challenges in Agile ?Tester Challenges in Agile ?
Tester Challenges in Agile ?alind tiwari
 
Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle Kari Kakkonen
 
The Importance of Culture: Building and Sustaining Effective Engineering Org...
The Importance of Culture:  Building and Sustaining Effective Engineering Org...The Importance of Culture:  Building and Sustaining Effective Engineering Org...
The Importance of Culture: Building and Sustaining Effective Engineering Org...Randy Shoup
 
Agile Testing in Enterprise: Way to transform - SQA Days 2014
Agile Testing in Enterprise: Way to transform - SQA Days 2014Agile Testing in Enterprise: Way to transform - SQA Days 2014
Agile Testing in Enterprise: Way to transform - SQA Days 2014Andrey Rebrov
 
RVA QA Meetup #2: The Wild West of Agile QA
RVA QA Meetup #2: The Wild West of Agile QARVA QA Meetup #2: The Wild West of Agile QA
RVA QA Meetup #2: The Wild West of Agile QAFord Prior
 
ISTQB agile tester exam - Conclusions about Certification
ISTQB agile tester exam - Conclusions about CertificationISTQB agile tester exam - Conclusions about Certification
ISTQB agile tester exam - Conclusions about CertificationMichał Dudziak
 
My Experiments In Agile Testing in Yahoo.pptx
My Experiments In Agile Testing in Yahoo.pptxMy Experiments In Agile Testing in Yahoo.pptx
My Experiments In Agile Testing in Yahoo.pptxBaiju Joseph
 
Agile testing experiments
Agile testing experimentsAgile testing experiments
Agile testing experimentsBaiju Joseph
 
From Incremental & Iterative to Agile – What's the Right Process For Your Tea...
From Incremental & Iterative to Agile – What's the Right Process For Your Tea...From Incremental & Iterative to Agile – What's the Right Process For Your Tea...
From Incremental & Iterative to Agile – What's the Right Process For Your Tea...Atlassian
 
Sustainable agile testing
Sustainable agile testingSustainable agile testing
Sustainable agile testingmimmozzo_
 
Agile Testing: The Role Of The Agile Tester
Agile Testing: The Role Of The Agile TesterAgile Testing: The Role Of The Agile Tester
Agile Testing: The Role Of The Agile TesterDeclan Whelan
 

Similar to We did it!!? There is place for QAs in Agile!!? (20)

Agile Way to First Iteration
Agile Way to First IterationAgile Way to First Iteration
Agile Way to First Iteration
 
New model
New modelNew model
New model
 
A New Model For Testing
A New Model For TestingA New Model For Testing
A New Model For Testing
 
Invite the tester to the party
Invite the tester to the partyInvite the tester to the party
Invite the tester to the party
 
Project management for qa manager
Project management for qa managerProject management for qa manager
Project management for qa manager
 
Agile Testing - What, why and how.
Agile Testing - What, why and how.Agile Testing - What, why and how.
Agile Testing - What, why and how.
 
Tester Challenges in Agile ?
Tester Challenges in Agile ?Tester Challenges in Agile ?
Tester Challenges in Agile ?
 
Agile process
Agile processAgile process
Agile process
 
Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle
 
The Importance of Culture: Building and Sustaining Effective Engineering Org...
The Importance of Culture:  Building and Sustaining Effective Engineering Org...The Importance of Culture:  Building and Sustaining Effective Engineering Org...
The Importance of Culture: Building and Sustaining Effective Engineering Org...
 
Agile Testing in Enterprise: Way to transform - SQA Days 2014
Agile Testing in Enterprise: Way to transform - SQA Days 2014Agile Testing in Enterprise: Way to transform - SQA Days 2014
Agile Testing in Enterprise: Way to transform - SQA Days 2014
 
RVA QA Meetup #2: The Wild West of Agile QA
RVA QA Meetup #2: The Wild West of Agile QARVA QA Meetup #2: The Wild West of Agile QA
RVA QA Meetup #2: The Wild West of Agile QA
 
Agile Testing
Agile TestingAgile Testing
Agile Testing
 
Agile testing
Agile testingAgile testing
Agile testing
 
ISTQB agile tester exam - Conclusions about Certification
ISTQB agile tester exam - Conclusions about CertificationISTQB agile tester exam - Conclusions about Certification
ISTQB agile tester exam - Conclusions about Certification
 
My Experiments In Agile Testing in Yahoo.pptx
My Experiments In Agile Testing in Yahoo.pptxMy Experiments In Agile Testing in Yahoo.pptx
My Experiments In Agile Testing in Yahoo.pptx
 
Agile testing experiments
Agile testing experimentsAgile testing experiments
Agile testing experiments
 
From Incremental & Iterative to Agile – What's the Right Process For Your Tea...
From Incremental & Iterative to Agile – What's the Right Process For Your Tea...From Incremental & Iterative to Agile – What's the Right Process For Your Tea...
From Incremental & Iterative to Agile – What's the Right Process For Your Tea...
 
Sustainable agile testing
Sustainable agile testingSustainable agile testing
Sustainable agile testing
 
Agile Testing: The Role Of The Agile Tester
Agile Testing: The Role Of The Agile TesterAgile Testing: The Role Of The Agile Tester
Agile Testing: The Role Of The Agile Tester
 

Recently uploaded

Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxHarnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxFIDO Alliance
 
AI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAnitaRaj43
 
ADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptxADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptxFIDO Alliance
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontologyjohnbeverley2021
 
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...ScyllaDB
 
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...FIDO Alliance
 
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?Paolo Missier
 
Generative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdfGenerative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdfalexjohnson7307
 
Introduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMIntroduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMKumar Satyam
 
UiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overviewUiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overviewDianaGray10
 
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...ScyllaDB
 
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsContinuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsLeah Henrickson
 
Microsoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireMicrosoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireExakis Nelite
 
Intro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxIntro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxFIDO Alliance
 
Portal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russePortal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russe中 央社
 
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdfFrisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdfAnubhavMangla3
 
Simplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptxSimplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptxMarkSteadman7
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...panagenda
 
How to Check CNIC Information Online with Pakdata cf
How to Check CNIC Information Online with Pakdata cfHow to Check CNIC Information Online with Pakdata cf
How to Check CNIC Information Online with Pakdata cfdanishmna97
 

Recently uploaded (20)

Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptxHarnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
Harnessing Passkeys in the Battle Against AI-Powered Cyber Threats.pptx
 
Overview of Hyperledger Foundation
Overview of Hyperledger FoundationOverview of Hyperledger Foundation
Overview of Hyperledger Foundation
 
AI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by Anitaraj
 
ADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptxADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptx
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
Event-Driven Architecture Masterclass: Integrating Distributed Data Stores Ac...
 
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...Hyatt driving innovation and exceptional customer experiences with FIDO passw...
Hyatt driving innovation and exceptional customer experiences with FIDO passw...
 
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
(Explainable) Data-Centric AI: what are you explaininhg, and to whom?
 
Generative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdfGenerative AI Use Cases and Applications.pdf
Generative AI Use Cases and Applications.pdf
 
Introduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDMIntroduction to use of FHIR Documents in ABDM
Introduction to use of FHIR Documents in ABDM
 
UiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overviewUiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overview
 
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
Event-Driven Architecture Masterclass: Engineering a Robust, High-performance...
 
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsContinuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
 
Microsoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - QuestionnaireMicrosoft CSP Briefing Pre-Engagement - Questionnaire
Microsoft CSP Briefing Pre-Engagement - Questionnaire
 
Intro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptxIntro to Passkeys and the State of Passwordless.pptx
Intro to Passkeys and the State of Passwordless.pptx
 
Portal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russePortal Kombat : extension du réseau de propagande russe
Portal Kombat : extension du réseau de propagande russe
 
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdfFrisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf
Frisco Automating Purchase Orders with MuleSoft IDP- May 10th, 2024.pptx.pdf
 
Simplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptxSimplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptx
 
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
Easier, Faster, and More Powerful – Alles Neu macht der Mai -Wir durchleuchte...
 
How to Check CNIC Information Online with Pakdata cf
How to Check CNIC Information Online with Pakdata cfHow to Check CNIC Information Online with Pakdata cf
How to Check CNIC Information Online with Pakdata cf
 

We did it!!? There is place for QAs in Agile!!?

  • 1. We did it!!? There is place for QAs in Agile!? Michał Kujałowicz michal.kujalowicz@spartez.com
  • 2. • Partner • Involved in development of core Atlassian products • Commercial, Open-Source add-ons, customizations • Developers, Product Managers, Designers, QAs, Agile Team Leads • Me: JIRA QA Team Lead
  • 3. QA vs Tester NOT TODAY, THANKS!
  • 4. My story 2006 ! • My first real Agile Project • About it later • Heard about Agile in 2006 on ISTQB straining • First project - 2006 • No one knew what to do • Testers in Agile? No experiences available • Short story 2012 2013 ! ! • Quality Assistance
  • 5. The fear 2009 Popularity Developer Testing Interdisciplinary Technical Skills
  • 6. How Agile is your team? “There are now many teams that label themselves as ‘agile’, but some agile teams are more agile than others”! ! ! ! ! ! ! ! ! ! ! ! Stuart Reid “Are all pigs equal?” Testing Experience 2009
  • 7. How Agile is your team? My take: • Team empowered to improve their process • Fast feedback and adaptation • Production ready increment as result of iteration • Everyone is responsible for the team’s output
  • 8. My first “real” Agile project • Test Manager • Around 10 developers at the beginning, 3 testers • From time perspective - not good • No shared quality responsibility, bad fitting, technical debt • No experience, no enough thinking, no guidance
  • 10. TOAST for Quality • A model helping organise QA process inside Agile project • Refers to whole quality process - not only QAs T - Types and Techniques O - Organisation! A - Added value S - Skills ! T - Tracking
  • 11. Types and Techniques - O - A - S - T • Which test types do you need to execute within your Agile process? • Which software characteristics you need to cover (performance, usability)? • What techniques will you use for those tests?
  • 12. Types and Techniques - • Types: O - A - S - T • Functional tests, Performance, Load, Stress, Usability, … • Techniques: • Scripted testing, Automated tests, Exploratory testing • White-box, Grey-box, Black-box
  • 13. Feature Story Story Feature … Task Release … Task … TO PRODUCTION but also Timing
  • 14. Feature Story but also Timing RELEASE TESTING PRODUCT ! REGRESSION Story Feature … Task Release … Task … STORY TESTING FEATURE ! REGRESSION PRODUCT ! REGRESSION FEATURE TESTING PRODUCT ! REGRESSION
  • 15. T - Organisation - A - S - T • How do you plan to organise testing activities? • Quality is the responsibility of the complete team! • What is the team setup (How many QAs? How many Developers)? • What is the QA role in testing activities?
  • 16. T - O - Added Value - S - T • Where do we add value beyond testing? • Automation, Business Analysis, Acceptance Criteria, Customer Support, Customer Contact, Test Data, Test Environments?
  • 17. T - O - A - Skills - T • What skills do we need in the team? • What do we need to do to fulfil needs? • Where can QAs specialise? • Are QAs technical enough?
  • 18. T - O - A - S - Tracking • How do we estimate QA activities and verify those? • How do we measure the process? • How do we measure product quality? • How do we get inputs for retrospective? • …
  • 20. Types Types, Techniques, Timing • Which software characteristics are crucial for you? • Functionality, Usability, Scalability, …ility • Depends on your context KEEP! CALM! ITS NOT IN! SCOPE
  • 21. Types, Techniques, Timing Agile Testing Quadrants “Agile Testing: A Practical Guide for Testers and Agile Teams” Lisa Crispin and Janet Gregory
  • 22. Techniques Types, Techniques, Timing • Scripted, Exploratory, Ad-hoc, Automated • White-box, Grey-box, Black-box ! • Agile moves onto Exploratory, White-Box and Automated
  • 23. Exploratory Types, Techniques, Timing “Telling your exploratory story” Jon Bach, Agile 2010
  • 24. SBTM Types, Techniques, Timing • Session Based Test Management • Charters • Sessions • Notes • Debriefing (PROOF)
  • 25. SBTM Types, Techniques, Timing Organisation “Adding value in an agile context” ! by Henrik Andersson
  • 26. SBTM Types, Techniques, Timing Organisation • Not only exp. testing technique but a whole organisational approach! • Every Testing activity is a Session (~90-minutes) • Estimate number of possible sessions for every iteration (3-4 sessions a day) • Fight on the Sprint planning to prioritise • Take metrics e.g. Sessions burndown chart
  • 27. Types, Techniques, Timing A word about exploratory • We do not know how to describe the exploratory thinking • Considered as ‘playing around’ without any test documentation • Fight that! • Think about it before encouraging your organisation
  • 28. Automation Types, Techniques, Timing UI Continuous Services Integration Unit Tests
  • 29. Feature Story RELEASE TESTING PRODUCT ! REGRESSION Story Feature … Task Release … Task … STORY TESTING FEATURE ! REGRESSION PRODUCT ! REGRESSION FEATURE TESTING PRODUCT ! REGRESSION Types, Techniques, Timing Timing
  • 30. Types, Techniques, Timing Timing • Think what you have and what you do not have! • The testing scope activities represent risks - not all risks must be covered with testing • … but they must be addressed!
  • 31. Release every 2 weeks FEATURES STORIES Testing Release 2-3 times a year FEATURES STORIES Types, Techniques, Timing NO (Optional) Blitz Test STORY TESTING Autom. (CI) Autom. (CI) FEATURE ! REGRESSION PRODUCT ! REGRESSION FEATURE TESTING PRODUCT ! REGRESSION RELEASE TESTING PRODUCT ! REGRESSION Release Feature Story Autom. (CI) Autom. (CI) Manual exploratory tests! + Automated tests
  • 32. Teams Organisation • QA is part of the team (3-4 developers) • Main responsibility - testing (moving towards exp. testing) ! • Other responsibilities = Added value • Everyone has ‘Developer’ role
  • 33. • Tool usage: sub-task of every story, separate testing tasks • Part of the definition of done • SBTM Tasks Organisation
  • 34. ! Organisation Quality is everyones responsibility! • No satisfying answer • Sharing partly testing with developers (checking vs. testing) • Unit tests, TDD, Automated tests • My answer: Quality Assistance
  • 35. Quality Assistance Organisation • 1 QA per 10 developers • Testing in hands of developers (both manual and automatic) • Teaches, mentors what and how to test, helps identifying most risk areas for testing • QA does not test - has time for process improvement, experimenting, bugs analysis, test tools
  • 36. Quality Assistance Organisation • Quality is indeed everyones responsibility • Automated tests from scratch • Tech camp presentation: • http://www.slideshare.net/mkujalowicz/1x10-the-role- of-qa-engineer-in-jira • http://vimeo.com/86691004
  • 37. Keys to succeed Added Value • The team must feel QA is mandatory element of the team and its every activity • Get the unique strengths and use them • support Product Owner to transfer customer needs onto backlog and acceptance criteria / automated tests • technical debt • test tooling and test coverage • …
  • 38. Added Value • Visibility of QAs work! • “Yesterday testing, today testing” • Daily stand-ups • Interesting idea: • ‘Report on your product’s health’ by Henrik Andersson (http://tvfortesters.com/video/adding-value- in-an-agile-context-by-henrik-andersson/)
  • 39. Added Value • TDD • ATDD • BDD • Specification by example • Not my cartoon :P - maybe yours? http://www.fanpop.com/clubs/dexters-laboratory/images/13130720/title/deedee-photo
  • 40. Added Value • Teaching / mentoring • Test tooling, test coverage • Process improvement, bug analysis • Customer view • We are “linkers” and “sharers”
  • 42. Technical skills Skills • Basics: • IDE, SCM situation, Reviews • White-box, Grey-box skills • Technologies • Further: • Depends on your project
  • 43. Skills Technical skills • Comes out of your added values analysis • Test techniques, Data gathering, Test Tools • Sorry - no recipe here ! • Go beyond what is on paper
  • 44. Tracking What should we track? • QA Tasks tracking • Internal and External product quality • Dev speed, QA speed • Product health • Product usage
  • 45. Tracking Do we do that? • Not much people sharing it • Create QA activities backlog and monitor its burn-down - SBTM and Test Sessions • Bugs and quality - we should have it covered - do we? In most projects - not trivial
  • 46. Tracking • Story rejection rate • OD Incidents, Stable regressions • Rework time • SaaS delivery index = JBS * 0.5 + PBS * 0.5 + C2M * 20 + C2DEV * 10 + D8W * -10 + NI * 100
  • 48. … our projects are different • Products in production for several years - not build from scratch • Almost full manual regression when switching to Agile • No automation possible/no automation in place • Test documentation requirements • Dislocated teams
  • 49. No automation Does not Scale
  • 50. No automation “Agile Testing” Tito Linz, Testwarez 2014
  • 51. No automation “Telling your exploratory story” Jon Bach, Agile 2010 But we require test documentation!
  • 52. Test documentation necessary • What is actually needed? What does one wants to achieve? • Does anyone read it at all? • Good exploratory testing charters • Find your own way!
  • 53. No automation • You won’t win without experimenting and taking risks! • Application specialist - interesting idea • Going further: White-box QA
  • 54. White-box QA • Pick the most technical person • Let her/him analyse the dependencies, how it works • Manual regression tests recommendations • Teach others how to do it
  • 55. No automation != no work on automation
  • 56. • Web Applications automation - easy • Desktop - mature • Mobile - growing but hard • Embedded - self-made ! • Start with quick wins - e.g. Visual Regression
  • 57. Multiple locations • Is it still Agile? • No unicorns here • Use the available tools, look for tools • Martin Fowler: “Using an Agile Software Process with Offshore Development”
  • 58. WHAT DO WE MISS
  • 59. What does it mean to be Agile QA Process & Product
  • 60. Unexplainable expectation • QA must limit the speed, QA must hold development plans, QA must make sure we do not take risks
  • 61. Product risks • What does it mean to leave this area untested? • What does it mean to leave this bug in release? • Gather data regarding customer usage
  • 62. Process risks • Experiment around your process • Take a risk to have time on process improvement • Failure is also a success • Make sure you know what success means
  • 63. Our story • QA Testing • Testing notes • DoTing • QA Demo • Dev as a QA
  • 64. The train is leaving • Development specificity changes • QA specificity changes: • Analytics, Experiments, A/B Testing, Continuous Deployment • Explore new paths!
  • 65. Summary • Think if you merit a TOAST? Not everything is required but it must be a conscious decision • QA work visibility • Think through your Regression test situation • Quality responsibility of the complete team - Quality Assistance • Take risks and experiment
  • 66. Satisfaction! The fear 2009 Popularity Developer Testing Interdisciplinary Technical Skills
  • 68. Images - credits • Żuraw in Gdańsk - by JM_GD - CC BY 2.0 • 3D Growth Projections - by Chris Potter - CC BY 2.0 • Architetto -- Donna casinista - by francesco_rollandin - CC BY 2.0 • Toast - by Stiefen Schlingen - CC BY 2.0 • Toasting Champagne - Waldo Jaquith - CC BY-SA 2.0 • Thinking - by Wade M - CC BY-SA 2.0 • Stadion Narodowy w Warszawie - by Artur Malinowski - CC BY 2.0 • Thumbup - Pratheepps - CC0 1.0 • Documentation - by Marta Pucciarelli - CC-BY-SA-3.0 • Difficult - Sea Turtle - CC BY-NC-ND 2.0 • Chemia Laboratorium Experyment - pixabay.com - CC0 1.0 • Comic Daredevil Bello Nock - Chris Phutully - CC BY 2.0 • Surprise major - by Achim Hering - CC-BY-SA-3.0 • Train Left - SElefant - CC-BY-SA-3.0