SlideShare a Scribd company logo
A Happy Marriage between
Context-Driven and Agile
llari Henrik Aegerter
Managing Director – House of Test
Executive at Large – Association for Software Testing (AST)
President – International Society for Software Testing (ISST)
@ilarihenrik
picture credit: https://www.flickr.com/photos/clement127/15504975089/
Today’s Menu
1. European Product Development
2. Automate everything?
3. How we did it
4. How you can make it work
5. Questions
European Product
Development - Structure
Automate Everything?
Checking vs. Testing
TDD is not testing
Ashby's Law of Requisite
Variety
Automated check
Passed Failed
Automated check
Passed Failed
there is a problem false alarmok missing a bug
did not run
Technical focus
image credit: https://www.flickr.com/photos/machintoy/3486236621
Social focus
image credit: https://www.flickr.com/photos/chrism70/272065545
image credit: http://kevinfream.com/virtual-cio
It’s not either or,
but as well as
How we did it
What was before?
Suspicion
We don’t
need no
stinkin’
testers!
Huh?
Testers?
image credit: https://www.flickr.com/photos/boston_public_library/7775298866
Integration
Tester
DEV
PO UX
DEV DEV
DEV DEV
DEV
PO UX
DEV DEV
DEV DEV
Team 1 Team 2
TesterDEV
PO UX
DEV DEV
DEV DEV
DEV
PO UX
DEV DEV
DEV DEV
Team 1 Team 2
Tester
Integration
Testers vs. Programmers
1:0?
image credit: https://www.flickr.com/photos/gordon2208/5093639901/in/photostream/
Where we are now
PO UX
DEV
PO UX
DEV DEV
DEV DEV
We want
a tester!
DEV
Tester
DEV
DEV DEV
DEV
Integration
Testers and Programmers
both win
image credit: https://www.flickr.com/photos/gordon2208/5093639901/in/photostream/
We are uncovering better ways of developing
software by doing it and helping others do it.
Through this work we have come to value:
Individuals and interactions over processes and tools
Working software over comprehensive documentation
Customer collaboration over contract negotiation
Responding to change over following a plan
That is, while there is value in the items on
the right, we value the items on the left more.
Agile Manifesto
1. The value of any practice depends on its context
2. There are good practices in context, but there are no best practices.
3. People, working together, are the most important part of any project’s context.
4. Projects unfold over time in ways that are often not predictable.
5. The product is a solution. If the problem isn’t solved, the product doesn’t work.
6. Good software testing is a challenging intellectual process.
7. Only through judgment and skill, exercised cooperatively throughout the entire
project, are we able to do the right things at the right times to effectively test our
products.
Context-Driven
PTE Agile Testing Manifesto
We believe that... By that we mean...
1 our main work product is
information relevant to people
who matter
We give feedback about the product as early as possible in a lean way, asking questions and providing information during pair
programming to prevent bugs.We report truthfully, concisely, allowing stakeholders to make informed decisions.We rapidly
uncover and report significant risks to the project.
2 we as testers explore the
differences between perception,
desire and reality
We understand that things can be different. Sometimes those differences are important. We uncover what those differences are
and where they may lead to problems. We discover new information by the skilled application of exploratory testing.
3 testing is a collaborative
endeavour
Testing is not delegated to testers only, but should also be done by everyone else in the team. The expertise of both testers and
developers enables a broader testing coverage. We closely collaborate with developers and work side-by-side every day.
4 learning about the domain is
crucial to doing a good job
No one has all the answers up front. Project requirements evolve over time. Rather than follow a rote plan, we learn as we test
and we use what we learn to guide what we test next. We aim to understand eBay systems and share our knowledge with our
peers.
5 ignorance about the domain is
not a reason not to test
We don't wait for a complete set of documentation and instructions before we start testing, but we apply good testing practices
at any given time.
6 the space between automation
and manual testing is a
continuum
Humans excel at qualitative analysis - we notice things. Machines do quantitative analysis very well - rapidly making boolean
choices. Our approach combines the two, ensuring that machines are employed for what they do best (automation, repetition
and tooling), while the rest is left to humans.
7 developing tools for the benefit
of all teams supports overall
productivity
We can be more effective if shared tools are in place to optimize repetitive tasks and avoid solving the same problem multiple
times. Those tools can either be sourced from outside or built in-house.
8 metrics are a way to start a
conversation and not to end it
Sometimes metrics are selected simply because they are easily available and not because their construct validity has been
established. Misapplied metrics can cause a lot of harm. We use metrics to help us achieve results, hence we value inquiry
metrics over evaluation metrics. http://www.developsense.com/blog/2009/01/meaningful-metrics/
9 we are not the gatekeepers of
quality
We provide information to allow others to make informed decisions, including "ship" / "no ship" decisions. We highlight risks. It is
up to our stakeholders to decide what to do based on that information.
10 our approach is applicable eBay
wide
We believe that an agile, embedded approach fosters close working relationships between testers and other roles. It helps
deliver more value more quickly and reduces unnecessary overhead.
www.ilari.com/agile
“By no means we want to put
ourselves above other testers.
We are just different. And by
different, we mean better.”
Ben Kelly, 2014
How you can make it work
BE PART OF THE
TEAM
BE INVOLVED RIGHT FROM
THE START
BRIDGE BETWEEN
DEVELOPERS & BUSINESS
PAIR ON TASKS
Image credit: http://jmyersdev.com/images/muppet-pair.png
Image credit: nla.pic-an24229822 Fitzpatrick, Jim, 1916
EDUCATE THE TEAM ABOUT
TESTING
What skills do you need?
WILLINGNESS TO LEARN
TECHNICAL AWARENESS
WILLINGNESS TO LEARN
TECHNICAL UNDERSTANDINGDOMAIN KNOWLEDGE
WILLINGNESS
TO LEARN
When craftspeople meet other
craftspeople, that’s where the
magic happens
Imagecredit:http://j.mp/LkUoLC
Questions?
ilari.aegerter@houseoftest.ch
@ilarihenrik
Imagecredit:http://j.mp/LkUoLC

More Related Content

What's hot

The Snail Entrepreneur: The 7-year-old kid every startup should learn from
The Snail Entrepreneur: The 7-year-old kid every startup should learn fromThe Snail Entrepreneur: The 7-year-old kid every startup should learn from
The Snail Entrepreneur: The 7-year-old kid every startup should learn from
Claudio Perrone
 
Michał Stryjak, Poznaj Context-Driven Testing
Michał Stryjak, Poznaj Context-Driven TestingMichał Stryjak, Poznaj Context-Driven Testing
Michał Stryjak, Poznaj Context-Driven Testing
Future Processing
 
Software Analytics: The Dark Side and the Test Side
Software Analytics: The Dark Side and the Test SideSoftware Analytics: The Dark Side and the Test Side
Software Analytics: The Dark Side and the Test Side
Andy Zaidman
 
Fact or Fiction? What Software Analytics Can Do For Us
Fact or Fiction? What Software Analytics Can Do For UsFact or Fiction? What Software Analytics Can Do For Us
Fact or Fiction? What Software Analytics Can Do For Us
Andy Zaidman
 
Software Analytics
Software AnalyticsSoftware Analytics
Software Analytics
Andy Zaidman
 
First steps in testing analytics: Does test code quality matter?
First steps in testing analytics: Does test code quality matter?First steps in testing analytics: Does test code quality matter?
First steps in testing analytics: Does test code quality matter?
Andy Zaidman
 
Test automation – the bitter truth
Test automation – the bitter truthTest automation – the bitter truth
Test automation – the bitter truth
Viktor Slavchev
 
[HCMC STC Jan 2015] Proving Our Worth Quantifying The Value Of Testing
[HCMC STC Jan 2015] Proving Our Worth  Quantifying The Value Of Testing[HCMC STC Jan 2015] Proving Our Worth  Quantifying The Value Of Testing
[HCMC STC Jan 2015] Proving Our Worth Quantifying The Value Of Testing
Ho Chi Minh City Software Testing Club
 
"Worst" practices of software testing
"Worst" practices of software testing"Worst" practices of software testing
"Worst" practices of software testing
Viktor Slavchev
 
State of selenium survey results
State of selenium survey resultsState of selenium survey results
State of selenium survey results
Tellurium
 
Automation vs. intelligence - "follow me if you want to live"
Automation vs. intelligence - "follow me if you want to live"Automation vs. intelligence - "follow me if you want to live"
Automation vs. intelligence - "follow me if you want to live"
Viktor Slavchev
 
Ian Agustiawan - Tech Days
Ian Agustiawan - Tech DaysIan Agustiawan - Tech Days
Ian Agustiawan - Tech DaysIan Agustiawan
 
Changing business of testing - Testing Assembly Helsinki 2014
Changing business of testing - Testing Assembly Helsinki 2014Changing business of testing - Testing Assembly Helsinki 2014
Changing business of testing - Testing Assembly Helsinki 2014
Vasco Duarte
 
A Guide to the Five Whys Technique
A Guide to the Five Whys TechniqueA Guide to the Five Whys Technique
A Guide to the Five Whys Technique
Olivier Serrat
 
Worst practices in software testing by the Testing troll
Worst practices in software testing by the Testing trollWorst practices in software testing by the Testing troll
Worst practices in software testing by the Testing troll
Viktor Slavchev
 
Five whys summary
Five whys summaryFive whys summary
Five whys summary
Steve Hayes
 
[HCMC STC Jan 2015] Creating a Better Testing Future
[HCMC STC Jan 2015] Creating a Better Testing Future[HCMC STC Jan 2015] Creating a Better Testing Future
[HCMC STC Jan 2015] Creating a Better Testing Future
Ho Chi Minh City Software Testing Club
 
Break to build - the mindset of the modern day tester
Break to build - the mindset of the modern day testerBreak to build - the mindset of the modern day tester
Break to build - the mindset of the modern day tester
Viktor Slavchev
 
Zero Bugs
Zero BugsZero Bugs
Zero Bugs
David Batten
 
Root cause analysis using 5 whys
Root cause analysis using 5 whysRoot cause analysis using 5 whys
Root cause analysis using 5 whys
Fahmi Ramadhan Putra
 

What's hot (20)

The Snail Entrepreneur: The 7-year-old kid every startup should learn from
The Snail Entrepreneur: The 7-year-old kid every startup should learn fromThe Snail Entrepreneur: The 7-year-old kid every startup should learn from
The Snail Entrepreneur: The 7-year-old kid every startup should learn from
 
Michał Stryjak, Poznaj Context-Driven Testing
Michał Stryjak, Poznaj Context-Driven TestingMichał Stryjak, Poznaj Context-Driven Testing
Michał Stryjak, Poznaj Context-Driven Testing
 
Software Analytics: The Dark Side and the Test Side
Software Analytics: The Dark Side and the Test SideSoftware Analytics: The Dark Side and the Test Side
Software Analytics: The Dark Side and the Test Side
 
Fact or Fiction? What Software Analytics Can Do For Us
Fact or Fiction? What Software Analytics Can Do For UsFact or Fiction? What Software Analytics Can Do For Us
Fact or Fiction? What Software Analytics Can Do For Us
 
Software Analytics
Software AnalyticsSoftware Analytics
Software Analytics
 
First steps in testing analytics: Does test code quality matter?
First steps in testing analytics: Does test code quality matter?First steps in testing analytics: Does test code quality matter?
First steps in testing analytics: Does test code quality matter?
 
Test automation – the bitter truth
Test automation – the bitter truthTest automation – the bitter truth
Test automation – the bitter truth
 
[HCMC STC Jan 2015] Proving Our Worth Quantifying The Value Of Testing
[HCMC STC Jan 2015] Proving Our Worth  Quantifying The Value Of Testing[HCMC STC Jan 2015] Proving Our Worth  Quantifying The Value Of Testing
[HCMC STC Jan 2015] Proving Our Worth Quantifying The Value Of Testing
 
"Worst" practices of software testing
"Worst" practices of software testing"Worst" practices of software testing
"Worst" practices of software testing
 
State of selenium survey results
State of selenium survey resultsState of selenium survey results
State of selenium survey results
 
Automation vs. intelligence - "follow me if you want to live"
Automation vs. intelligence - "follow me if you want to live"Automation vs. intelligence - "follow me if you want to live"
Automation vs. intelligence - "follow me if you want to live"
 
Ian Agustiawan - Tech Days
Ian Agustiawan - Tech DaysIan Agustiawan - Tech Days
Ian Agustiawan - Tech Days
 
Changing business of testing - Testing Assembly Helsinki 2014
Changing business of testing - Testing Assembly Helsinki 2014Changing business of testing - Testing Assembly Helsinki 2014
Changing business of testing - Testing Assembly Helsinki 2014
 
A Guide to the Five Whys Technique
A Guide to the Five Whys TechniqueA Guide to the Five Whys Technique
A Guide to the Five Whys Technique
 
Worst practices in software testing by the Testing troll
Worst practices in software testing by the Testing trollWorst practices in software testing by the Testing troll
Worst practices in software testing by the Testing troll
 
Five whys summary
Five whys summaryFive whys summary
Five whys summary
 
[HCMC STC Jan 2015] Creating a Better Testing Future
[HCMC STC Jan 2015] Creating a Better Testing Future[HCMC STC Jan 2015] Creating a Better Testing Future
[HCMC STC Jan 2015] Creating a Better Testing Future
 
Break to build - the mindset of the modern day tester
Break to build - the mindset of the modern day testerBreak to build - the mindset of the modern day tester
Break to build - the mindset of the modern day tester
 
Zero Bugs
Zero BugsZero Bugs
Zero Bugs
 
Root cause analysis using 5 whys
Root cause analysis using 5 whysRoot cause analysis using 5 whys
Root cause analysis using 5 whys
 

Viewers also liked

Exploratory Session Based Testing…With A Twist Star East 2009
Exploratory Session Based Testing…With A Twist   Star East 2009Exploratory Session Based Testing…With A Twist   Star East 2009
Exploratory Session Based Testing…With A Twist Star East 2009
aandelkovic
 
Exploratory testing by Rik Marselis
Exploratory testing by Rik MarselisExploratory testing by Rik Marselis
Exploratory testing by Rik Marselis
Rik Marselis
 
Fear the psychology of testing rik marselis
Fear the psychology of testing rik marselisFear the psychology of testing rik marselis
Fear the psychology of testing rik marselis
Rik Marselis
 
What is this exploratory testing thing
What is this exploratory testing thingWhat is this exploratory testing thing
What is this exploratory testing thing
tonybruce
 
Tips for Writing Better Charters for Exploratory Testing Sessions by Michael...
 Tips for Writing Better Charters for Exploratory Testing Sessions by Michael... Tips for Writing Better Charters for Exploratory Testing Sessions by Michael...
Tips for Writing Better Charters for Exploratory Testing Sessions by Michael...
TEST Huddle
 
Exploratory Testing
Exploratory TestingExploratory Testing
Exploratory Testing
sriks7
 
Culture
CultureCulture
Culture
Reed Hastings
 

Viewers also liked (7)

Exploratory Session Based Testing…With A Twist Star East 2009
Exploratory Session Based Testing…With A Twist   Star East 2009Exploratory Session Based Testing…With A Twist   Star East 2009
Exploratory Session Based Testing…With A Twist Star East 2009
 
Exploratory testing by Rik Marselis
Exploratory testing by Rik MarselisExploratory testing by Rik Marselis
Exploratory testing by Rik Marselis
 
Fear the psychology of testing rik marselis
Fear the psychology of testing rik marselisFear the psychology of testing rik marselis
Fear the psychology of testing rik marselis
 
What is this exploratory testing thing
What is this exploratory testing thingWhat is this exploratory testing thing
What is this exploratory testing thing
 
Tips for Writing Better Charters for Exploratory Testing Sessions by Michael...
 Tips for Writing Better Charters for Exploratory Testing Sessions by Michael... Tips for Writing Better Charters for Exploratory Testing Sessions by Michael...
Tips for Writing Better Charters for Exploratory Testing Sessions by Michael...
 
Exploratory Testing
Exploratory TestingExploratory Testing
Exploratory Testing
 
Culture
CultureCulture
Culture
 

Similar to A Happy Marriage between Context-Driven and Agile

A Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software TestingA Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software TestingTechWell
 
A Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software TestingA Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software Testing
TechWell
 
Agile Software Development - Session 1
Agile Software Development - Session 1Agile Software Development - Session 1
Agile Software Development - Session 1
Dalia Ayman Ahmed
 
Is data visualisation bullshit?
Is data visualisation bullshit?Is data visualisation bullshit?
Is data visualisation bullshit?
Alban Gérôme
 
Effective Testing fo Startups
Effective Testing fo StartupsEffective Testing fo Startups
Effective Testing fo Startups
Testnetic
 
Rapid Prototyping and Usability Testing - HUXPA
Rapid Prototyping and Usability Testing - HUXPARapid Prototyping and Usability Testing - HUXPA
Rapid Prototyping and Usability Testing - HUXPA
Derrick Bowen
 
Graham Thomas - Software Testing Secrets We Dare Not Tell - EuroSTAR 2013
Graham Thomas - Software Testing Secrets We Dare Not Tell - EuroSTAR 2013Graham Thomas - Software Testing Secrets We Dare Not Tell - EuroSTAR 2013
Graham Thomas - Software Testing Secrets We Dare Not Tell - EuroSTAR 2013
TEST Huddle
 
What is testing
What is testingWhat is testing
What is testing
Bayu Andika Pratama
 
Business analysis1.9 - business side
Business analysis1.9 - business sideBusiness analysis1.9 - business side
Business analysis1.9 - business side
Anton Galitskiy
 
How do we fix testing
How do we fix testingHow do we fix testing
How do we fix testing
Peter Varhol
 
The Leaders Guide to Getting Started with Automated Testing
The Leaders Guide to Getting Started with Automated TestingThe Leaders Guide to Getting Started with Automated Testing
The Leaders Guide to Getting Started with Automated Testing
James Briers
 
Software testing _mod_9
Software testing _mod_9Software testing _mod_9
Software testing _mod_9
hellosashi
 
Presented at Ford's 2017 Global IT Learning Summit (GLITS)
Presented at Ford's 2017 Global IT Learning Summit (GLITS)Presented at Ford's 2017 Global IT Learning Summit (GLITS)
Presented at Ford's 2017 Global IT Learning Summit (GLITS)
Ron Lazaro
 
Software testing-in-gurgaon
Software testing-in-gurgaonSoftware testing-in-gurgaon
Software testing-in-gurgaon
AP EDUSOFT
 
A Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software TestingA Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software Testing
TechWell
 
Basics in software testing
Basics in software testingBasics in software testing
Basics in software testing
TOPS Technologies
 
Agile product development
Agile product developmentAgile product development
Agile product development
Brenn Hill
 
Usability Testing On A Digital Product
Usability Testing On A Digital ProductUsability Testing On A Digital Product
Usability Testing On A Digital Product
Kyle Soucy
 
Bab 1
Bab 1Bab 1
Rapid software testing
Rapid software testingRapid software testing
Rapid software testingSachin MK
 

Similar to A Happy Marriage between Context-Driven and Agile (20)

A Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software TestingA Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software Testing
 
A Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software TestingA Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software Testing
 
Agile Software Development - Session 1
Agile Software Development - Session 1Agile Software Development - Session 1
Agile Software Development - Session 1
 
Is data visualisation bullshit?
Is data visualisation bullshit?Is data visualisation bullshit?
Is data visualisation bullshit?
 
Effective Testing fo Startups
Effective Testing fo StartupsEffective Testing fo Startups
Effective Testing fo Startups
 
Rapid Prototyping and Usability Testing - HUXPA
Rapid Prototyping and Usability Testing - HUXPARapid Prototyping and Usability Testing - HUXPA
Rapid Prototyping and Usability Testing - HUXPA
 
Graham Thomas - Software Testing Secrets We Dare Not Tell - EuroSTAR 2013
Graham Thomas - Software Testing Secrets We Dare Not Tell - EuroSTAR 2013Graham Thomas - Software Testing Secrets We Dare Not Tell - EuroSTAR 2013
Graham Thomas - Software Testing Secrets We Dare Not Tell - EuroSTAR 2013
 
What is testing
What is testingWhat is testing
What is testing
 
Business analysis1.9 - business side
Business analysis1.9 - business sideBusiness analysis1.9 - business side
Business analysis1.9 - business side
 
How do we fix testing
How do we fix testingHow do we fix testing
How do we fix testing
 
The Leaders Guide to Getting Started with Automated Testing
The Leaders Guide to Getting Started with Automated TestingThe Leaders Guide to Getting Started with Automated Testing
The Leaders Guide to Getting Started with Automated Testing
 
Software testing _mod_9
Software testing _mod_9Software testing _mod_9
Software testing _mod_9
 
Presented at Ford's 2017 Global IT Learning Summit (GLITS)
Presented at Ford's 2017 Global IT Learning Summit (GLITS)Presented at Ford's 2017 Global IT Learning Summit (GLITS)
Presented at Ford's 2017 Global IT Learning Summit (GLITS)
 
Software testing-in-gurgaon
Software testing-in-gurgaonSoftware testing-in-gurgaon
Software testing-in-gurgaon
 
A Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software TestingA Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software Testing
 
Basics in software testing
Basics in software testingBasics in software testing
Basics in software testing
 
Agile product development
Agile product developmentAgile product development
Agile product development
 
Usability Testing On A Digital Product
Usability Testing On A Digital ProductUsability Testing On A Digital Product
Usability Testing On A Digital Product
 
Bab 1
Bab 1Bab 1
Bab 1
 
Rapid software testing
Rapid software testingRapid software testing
Rapid software testing
 

More from Ilari Henrik Aegerter

Observe model - design - test - report
Observe   model - design - test - reportObserve   model - design - test - report
Observe model - design - test - report
Ilari Henrik Aegerter
 
What if you cannot see each other?
What if you cannot see each other?What if you cannot see each other?
What if you cannot see each other?
Ilari Henrik Aegerter
 
Testers are your friends
Testers are your friendsTesters are your friends
Testers are your friends
Ilari Henrik Aegerter
 
Utter failures and lessons remained unlearned
Utter failures and lessons remained unlearnedUtter failures and lessons remained unlearned
Utter failures and lessons remained unlearnedIlari Henrik Aegerter
 
Observation ninjas & description superheros
Observation ninjas & description superherosObservation ninjas & description superheros
Observation ninjas & description superherosIlari Henrik Aegerter
 
Heute konfigurieren wir ihr perfektes test team und erobern dann morgen damit...
Heute konfigurieren wir ihr perfektes test team und erobern dann morgen damit...Heute konfigurieren wir ihr perfektes test team und erobern dann morgen damit...
Heute konfigurieren wir ihr perfektes test team und erobern dann morgen damit...Ilari Henrik Aegerter
 
Crazy leaders, micromanagement and blaming culture - is there an alternative
Crazy leaders, micromanagement and blaming culture - is there an alternativeCrazy leaders, micromanagement and blaming culture - is there an alternative
Crazy leaders, micromanagement and blaming culture - is there an alternativeIlari Henrik Aegerter
 

More from Ilari Henrik Aegerter (10)

Observe model - design - test - report
Observe   model - design - test - reportObserve   model - design - test - report
Observe model - design - test - report
 
What if you cannot see each other?
What if you cannot see each other?What if you cannot see each other?
What if you cannot see each other?
 
Testers are your friends
Testers are your friendsTesters are your friends
Testers are your friends
 
Utter failures and lessons remained unlearned
Utter failures and lessons remained unlearnedUtter failures and lessons remained unlearned
Utter failures and lessons remained unlearned
 
Observation ninjas & description superheros
Observation ninjas & description superherosObservation ninjas & description superheros
Observation ninjas & description superheros
 
How to make'em read books
How to make'em read booksHow to make'em read books
How to make'em read books
 
Observational Proficiency
Observational ProficiencyObservational Proficiency
Observational Proficiency
 
Heute konfigurieren wir ihr perfektes test team und erobern dann morgen damit...
Heute konfigurieren wir ihr perfektes test team und erobern dann morgen damit...Heute konfigurieren wir ihr perfektes test team und erobern dann morgen damit...
Heute konfigurieren wir ihr perfektes test team und erobern dann morgen damit...
 
On bug reporting
On bug reportingOn bug reporting
On bug reporting
 
Crazy leaders, micromanagement and blaming culture - is there an alternative
Crazy leaders, micromanagement and blaming culture - is there an alternativeCrazy leaders, micromanagement and blaming culture - is there an alternative
Crazy leaders, micromanagement and blaming culture - is there an alternative
 

Recently uploaded

Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Inflectra
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Sri Ambati
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
DianaGray10
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical Futures
Bhaskar Mitra
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
Ralf Eggert
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
Elena Simperl
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
BookNet Canada
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Tobias Schneck
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
OnBoard
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
Product School
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Thierry Lestable
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
Product School
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance
 
"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi
Fwdays
 

Recently uploaded (20)

Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualitySoftware Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered Quality
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical Futures
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
 
When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...When stars align: studies in data quality, knowledge graphs, and machine lear...
When stars align: studies in data quality, knowledge graphs, and machine lear...
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
Leading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdfLeading Change strategies and insights for effective change management pdf 1.pdf
Leading Change strategies and insights for effective change management pdf 1.pdf
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
 
"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi"Impact of front-end architecture on development cost", Viktor Turskyi
"Impact of front-end architecture on development cost", Viktor Turskyi
 

A Happy Marriage between Context-Driven and Agile

  • 1. A Happy Marriage between Context-Driven and Agile
  • 2. llari Henrik Aegerter Managing Director – House of Test Executive at Large – Association for Software Testing (AST) President – International Society for Software Testing (ISST) @ilarihenrik
  • 4. Today’s Menu 1. European Product Development 2. Automate everything? 3. How we did it 4. How you can make it work 5. Questions
  • 5.
  • 7.
  • 10. TDD is not testing Ashby's Law of Requisite Variety
  • 12. Automated check Passed Failed there is a problem false alarmok missing a bug did not run
  • 13. Technical focus image credit: https://www.flickr.com/photos/machintoy/3486236621
  • 14. Social focus image credit: https://www.flickr.com/photos/chrism70/272065545
  • 17.
  • 19. Suspicion We don’t need no stinkin’ testers! Huh? Testers? image credit: https://www.flickr.com/photos/boston_public_library/7775298866
  • 21. Tester DEV PO UX DEV DEV DEV DEV DEV PO UX DEV DEV DEV DEV Team 1 Team 2
  • 22. TesterDEV PO UX DEV DEV DEV DEV DEV PO UX DEV DEV DEV DEV Team 1 Team 2 Tester
  • 23. Integration Testers vs. Programmers 1:0? image credit: https://www.flickr.com/photos/gordon2208/5093639901/in/photostream/
  • 25. PO UX DEV PO UX DEV DEV DEV DEV We want a tester! DEV Tester DEV DEV DEV DEV
  • 26. Integration Testers and Programmers both win image credit: https://www.flickr.com/photos/gordon2208/5093639901/in/photostream/
  • 27. We are uncovering better ways of developing software by doing it and helping others do it. Through this work we have come to value: Individuals and interactions over processes and tools Working software over comprehensive documentation Customer collaboration over contract negotiation Responding to change over following a plan That is, while there is value in the items on the right, we value the items on the left more. Agile Manifesto
  • 28. 1. The value of any practice depends on its context 2. There are good practices in context, but there are no best practices. 3. People, working together, are the most important part of any project’s context. 4. Projects unfold over time in ways that are often not predictable. 5. The product is a solution. If the problem isn’t solved, the product doesn’t work. 6. Good software testing is a challenging intellectual process. 7. Only through judgment and skill, exercised cooperatively throughout the entire project, are we able to do the right things at the right times to effectively test our products. Context-Driven
  • 29. PTE Agile Testing Manifesto We believe that... By that we mean... 1 our main work product is information relevant to people who matter We give feedback about the product as early as possible in a lean way, asking questions and providing information during pair programming to prevent bugs.We report truthfully, concisely, allowing stakeholders to make informed decisions.We rapidly uncover and report significant risks to the project. 2 we as testers explore the differences between perception, desire and reality We understand that things can be different. Sometimes those differences are important. We uncover what those differences are and where they may lead to problems. We discover new information by the skilled application of exploratory testing. 3 testing is a collaborative endeavour Testing is not delegated to testers only, but should also be done by everyone else in the team. The expertise of both testers and developers enables a broader testing coverage. We closely collaborate with developers and work side-by-side every day. 4 learning about the domain is crucial to doing a good job No one has all the answers up front. Project requirements evolve over time. Rather than follow a rote plan, we learn as we test and we use what we learn to guide what we test next. We aim to understand eBay systems and share our knowledge with our peers. 5 ignorance about the domain is not a reason not to test We don't wait for a complete set of documentation and instructions before we start testing, but we apply good testing practices at any given time. 6 the space between automation and manual testing is a continuum Humans excel at qualitative analysis - we notice things. Machines do quantitative analysis very well - rapidly making boolean choices. Our approach combines the two, ensuring that machines are employed for what they do best (automation, repetition and tooling), while the rest is left to humans. 7 developing tools for the benefit of all teams supports overall productivity We can be more effective if shared tools are in place to optimize repetitive tasks and avoid solving the same problem multiple times. Those tools can either be sourced from outside or built in-house. 8 metrics are a way to start a conversation and not to end it Sometimes metrics are selected simply because they are easily available and not because their construct validity has been established. Misapplied metrics can cause a lot of harm. We use metrics to help us achieve results, hence we value inquiry metrics over evaluation metrics. http://www.developsense.com/blog/2009/01/meaningful-metrics/ 9 we are not the gatekeepers of quality We provide information to allow others to make informed decisions, including "ship" / "no ship" decisions. We highlight risks. It is up to our stakeholders to decide what to do based on that information. 10 our approach is applicable eBay wide We believe that an agile, embedded approach fosters close working relationships between testers and other roles. It helps deliver more value more quickly and reduces unnecessary overhead. www.ilari.com/agile
  • 30. “By no means we want to put ourselves above other testers. We are just different. And by different, we mean better.” Ben Kelly, 2014
  • 31. How you can make it work
  • 32. BE PART OF THE TEAM
  • 33. BE INVOLVED RIGHT FROM THE START
  • 35. PAIR ON TASKS Image credit: http://jmyersdev.com/images/muppet-pair.png
  • 36. Image credit: nla.pic-an24229822 Fitzpatrick, Jim, 1916 EDUCATE THE TEAM ABOUT TESTING
  • 37. What skills do you need?
  • 39. WILLINGNESS TO LEARN TECHNICAL UNDERSTANDINGDOMAIN KNOWLEDGE
  • 41. When craftspeople meet other craftspeople, that’s where the magic happens

Editor's Notes

  1. Algoritmisches vs. Heuristisches Vorgehen Binäre (oder diskrete, oder kontinuierliche) Evaluation -> erwarteter Ausgang bekannt Verletzung einer expliziten Erwartung vs. Verletzung einer impliziten Erwartung