SlideShare a Scribd company logo
1 of 20
Testing in modern times
“a story about Quality and Value”
SoftwareDevelopment = R&D
Research& Development
Research& Development:
Dealing with unknownunknowns
Capture everything upfront vs. building new insights
Customers don’t know what they want
Cope with complexity, confusion, change, new insights and halfanswers
So: We need to learn and to deal with risks!
Testingand quality?
Testing informs decisions about quality & risk
Quality isvalue to people who matter
Quality is NOT: conformance to requirements
Quality is NOT: the best product possible
Quality products solve the problem and are “good enough”
Business caseof testing?
Business caseof LEARNING?
The question is: do you value learning?And if so: how much are you willingto pay?
If you value it enough,you won'tdiscuss the price...
But are thecosts justified?
Or learn to live withoutit … withallrisks involved.
Reduce cost oftesting?
Focus on Testability!
Reduce cost oftesting?
Focus on Testability!
Learnability (*)
learning
(*)Learnability: not the old ISO9126definition
My definition: how easy is it tolearn about the value and risks of a product/solution
Testabilityyousay?
Testability of a product is how easy it is to learn (read: test) by a particular team in a given context.
Learning about testability
10 P’s of Testability
Read more about this here:
Team Guide to Software Testability - Better
software through greater testability
By Ash Winter and Rob Meaney
(http://leanpub.com/softwaretestability)
Automate everything?
Automated checks provide binary answers to a question to which you
already know the answer.
We need a lot of checks to speed up development by detecting
regression problems.
Exploring can provide new insights into the product. Only people can
provide this insight.
Can everybodytest?
Sure. The question is: how good do you want it to be?
Most people do not like testing at all!And that is why they will never be good at it. Nor do they
have time to learn these skills.
We need smart people with "critical distance” to do skilled testing. People determined to find
problems thatmatter.
Problems asin: ”are there problems thatthreaten the value of the product or the on‐time
successfuldelivery?”
So are we stilltalkingabout testing? Or is it muchbroader?
About critical distance
We need a diversity in thinking: different mindsets
Opportunity mindset
Solve problems
Ask howand whenquestions
Problem mindset
Search for problems
Ask what if questions
Learning in teams: it’s all about loops!
Create learning loops (Plan-Do-Check-Act) in everything you do
Team collaboration and skills are key: optimize your SDLC and processes
Risks are a whole team responsibility
Test your requirements & assumptions continuously
Help programmers go faster: devand release pipelines, automated checks, codequality, measuring the right
metrics
Test enough (good is good enough): test & automation strategy! Oreven better: an integrated quality strategy
based on risks
Use tooling & automation in your exploration
Mitigate “appropriate” risks by nottesting: monitoring, test in production, etc.
Learning in teams: it’s all about loops!
Focus onfast learning in ourteams:
Whole team quality!
So are westilltalkingabout testing?
Thank you!
Comments
or
Questions ??
Referencesand more info
Let’s stoptalking abouttesting,let’sstartthinking aboutvalue - http://www.huibschoots.nl/wordpress/?p=2763
Anne-MarieCharrett- Quality isaTeam Responsibility- https://youtu.be/mBC3ssLlJfQ
Anne-MarieCharrett- ScrewTesting,Let’s Talk Quality - https://youtu.be/v4uw29pW73E
TeamGuide toSoftwareTestability- http://leanpub.com/softwaretestability
HeuristicsofSoftwareTestability - https://www.satisfice.com/download/heuristics-of-software-testability
InterviewwithRob MeaneyonQualitycoachingroadshow- https://www.spreaker.com/show/quality-coaching
TestabilityAsk Me Anything(Ash Winter) - https://www.ministryoftesting.com/dojo/lessons/testing-ask-me-anything-testability-ash-winter
QualityEngineeringAsk me Anything (Anne-MarieCharrett)- https://www.ministryoftesting.com/dojo/series/testing-ask-me-anything/lessons/ask-me-anything-anne-
marie-charrett-quality-engineering
Rapidsoftwaretesting–https://www.rapid-software-testing.com
Collectedlinks op mywebsite- http://www.huibschoots.nl/links
WhoamI?
Context-drivensoftwaretester
RapidSoftwareTestingteacher
Scrummaster,team coach&agileexpert
Humanist
Curious& lifelonglearner
Passionate&energeticpeoplelover
Trainer,coach,consultant,writer,speaker
Storyteller,leader,human,rebel,jiggler
Trombone& guitar player,photographer,gamer, beer brewer,magician
2017
Most Influential Agile
Testing Professional Person
Huib Schoots
huib@deagiletesters.nl
06–24641033
www.linkedin.com/in/huibschoots/
www.huibschoots.nl
www.deagiletesters.nl

More Related Content

What's hot

Fresh From Academia to Industry- You WOn't Believe What HAppens Next!
Fresh From Academia to Industry- You WOn't Believe What HAppens Next!Fresh From Academia to Industry- You WOn't Believe What HAppens Next!
Fresh From Academia to Industry- You WOn't Believe What HAppens Next!Jordan Gosselin
 
How To Make Better Product Decisions
How To Make Better Product DecisionsHow To Make Better Product Decisions
How To Make Better Product DecisionsStartup Product
 
Customer Discovery at Venture Out Moldova, Fall 2013
Customer Discovery at Venture Out Moldova, Fall 2013Customer Discovery at Venture Out Moldova, Fall 2013
Customer Discovery at Venture Out Moldova, Fall 2013David Kirsch
 
Graham Thomas - The Testers Toolbox - EuroSTAR 2010
Graham Thomas - The Testers Toolbox - EuroSTAR 2010Graham Thomas - The Testers Toolbox - EuroSTAR 2010
Graham Thomas - The Testers Toolbox - EuroSTAR 2010TEST Huddle
 
Imrul: Context Driven Testing
Imrul: Context Driven TestingImrul: Context Driven Testing
Imrul: Context Driven TestingSQABD
 
Context driven tester
Context driven testerContext driven tester
Context driven testerWasiqul Huq
 
The Abolition of Test
The Abolition of TestThe Abolition of Test
The Abolition of TestMatt Mansell
 
Digital Gaggle | September 2017 SEO Conference | Stephen Pavlovich 'Applying ...
Digital Gaggle | September 2017 SEO Conference | Stephen Pavlovich 'Applying ...Digital Gaggle | September 2017 SEO Conference | Stephen Pavlovich 'Applying ...
Digital Gaggle | September 2017 SEO Conference | Stephen Pavlovich 'Applying ...Noisy Little Monkey
 
Test Managers: How You Can Really Make a Difference
Test Managers: How You Can Really Make a DifferenceTest Managers: How You Can Really Make a Difference
Test Managers: How You Can Really Make a DifferenceTechWell
 
Sprintz work Fact Sheet
Sprintz work Fact SheetSprintz work Fact Sheet
Sprintz work Fact SheetBryan Cassady
 
The Changing Face of Test Management in an Agile World
The Changing Face of Test Management in an Agile WorldThe Changing Face of Test Management in an Agile World
The Changing Face of Test Management in an Agile WorldTechWell
 
Going from Good to Great with Concept Testing
Going from Good to Great with Concept TestingGoing from Good to Great with Concept Testing
Going from Good to Great with Concept TestingAtlassian
 
Product Design - Rui Barroca
Product Design - Rui BarrocaProduct Design - Rui Barroca
Product Design - Rui BarrocaStartup Braga
 
Problem solving section 1
Problem solving section 1Problem solving section 1
Problem solving section 1dwyer1an
 
Building a QA Mindset
Building a QA Mindset Building a QA Mindset
Building a QA Mindset Johan Hoberg
 
Applying good context driven testing in an agile context
Applying good context driven testing in an agile contextApplying good context driven testing in an agile context
Applying good context driven testing in an agile contextMarkus Gärtner
 
Charting the right course for your projects
Charting the right course for your projectsCharting the right course for your projects
Charting the right course for your projectsRaymond Stadnik
 

What's hot (20)

The two largest project killers
The two largest project killersThe two largest project killers
The two largest project killers
 
Fresh From Academia to Industry- You WOn't Believe What HAppens Next!
Fresh From Academia to Industry- You WOn't Believe What HAppens Next!Fresh From Academia to Industry- You WOn't Believe What HAppens Next!
Fresh From Academia to Industry- You WOn't Believe What HAppens Next!
 
How To Make Better Product Decisions
How To Make Better Product DecisionsHow To Make Better Product Decisions
How To Make Better Product Decisions
 
Customer Discovery at Venture Out Moldova, Fall 2013
Customer Discovery at Venture Out Moldova, Fall 2013Customer Discovery at Venture Out Moldova, Fall 2013
Customer Discovery at Venture Out Moldova, Fall 2013
 
Graham Thomas - The Testers Toolbox - EuroSTAR 2010
Graham Thomas - The Testers Toolbox - EuroSTAR 2010Graham Thomas - The Testers Toolbox - EuroSTAR 2010
Graham Thomas - The Testers Toolbox - EuroSTAR 2010
 
Team objectives
Team objectivesTeam objectives
Team objectives
 
Imrul: Context Driven Testing
Imrul: Context Driven TestingImrul: Context Driven Testing
Imrul: Context Driven Testing
 
Context driven tester
Context driven testerContext driven tester
Context driven tester
 
The Abolition of Test
The Abolition of TestThe Abolition of Test
The Abolition of Test
 
Digital Gaggle | September 2017 SEO Conference | Stephen Pavlovich 'Applying ...
Digital Gaggle | September 2017 SEO Conference | Stephen Pavlovich 'Applying ...Digital Gaggle | September 2017 SEO Conference | Stephen Pavlovich 'Applying ...
Digital Gaggle | September 2017 SEO Conference | Stephen Pavlovich 'Applying ...
 
Test Managers: How You Can Really Make a Difference
Test Managers: How You Can Really Make a DifferenceTest Managers: How You Can Really Make a Difference
Test Managers: How You Can Really Make a Difference
 
Sprintz work Fact Sheet
Sprintz work Fact SheetSprintz work Fact Sheet
Sprintz work Fact Sheet
 
The Changing Face of Test Management in an Agile World
The Changing Face of Test Management in an Agile WorldThe Changing Face of Test Management in an Agile World
The Changing Face of Test Management in an Agile World
 
Going from Good to Great with Concept Testing
Going from Good to Great with Concept TestingGoing from Good to Great with Concept Testing
Going from Good to Great with Concept Testing
 
Product Design - Rui Barroca
Product Design - Rui BarrocaProduct Design - Rui Barroca
Product Design - Rui Barroca
 
Problem solving section 1
Problem solving section 1Problem solving section 1
Problem solving section 1
 
Building a QA Mindset
Building a QA Mindset Building a QA Mindset
Building a QA Mindset
 
Applying good context driven testing in an agile context
Applying good context driven testing in an agile contextApplying good context driven testing in an agile context
Applying good context driven testing in an agile context
 
Charting the right course for your projects
Charting the right course for your projectsCharting the right course for your projects
Charting the right course for your projects
 
Perfect Reliability
Perfect ReliabilityPerfect Reliability
Perfect Reliability
 

Similar to Testing and Learning in Modern Times

Huib Schoots Testing in modern times - a story about Quality and Value - Test...
Huib Schoots Testing in modern times - a story about Quality and Value - Test...Huib Schoots Testing in modern times - a story about Quality and Value - Test...
Huib Schoots Testing in modern times - a story about Quality and Value - Test...FiSTB
 
Lean Business Validation experiments
Lean Business Validation experimentsLean Business Validation experiments
Lean Business Validation experimentsBundl
 
Agile Product Management - Co-Training with Angel Medinilla (c)
Agile Product Management - Co-Training with Angel Medinilla (c)Agile Product Management - Co-Training with Angel Medinilla (c)
Agile Product Management - Co-Training with Angel Medinilla (c)Andrea Darabos
 
Change the conversation keynote StarWest 2015
Change the conversation keynote StarWest 2015Change the conversation keynote StarWest 2015
Change the conversation keynote StarWest 2015Janet Gregory
 
2016.08.THAT Conference - GROWING NEW PRODUCTS - VALIDATING YOUR NEW PRODUCT ...
2016.08.THAT Conference - GROWING NEW PRODUCTS - VALIDATING YOUR NEW PRODUCT ...2016.08.THAT Conference - GROWING NEW PRODUCTS - VALIDATING YOUR NEW PRODUCT ...
2016.08.THAT Conference - GROWING NEW PRODUCTS - VALIDATING YOUR NEW PRODUCT ...Ryan D. Hatch
 
Experimentation for PMs: A Primer by Amazon Director of Product
Experimentation for PMs: A Primer by Amazon Director of ProductExperimentation for PMs: A Primer by Amazon Director of Product
Experimentation for PMs: A Primer by Amazon Director of ProductProduct School
 
Intro to Product Discovery
Intro to Product DiscoveryIntro to Product Discovery
Intro to Product DiscoveryMatthew Godfrey
 
I’m an Agile Test Manager: Do I really exist?
I’m an Agile Test Manager:Do I really exist?I’m an Agile Test Manager:Do I really exist?
I’m an Agile Test Manager: Do I really exist?elliando dias
 
150 Startups Kick-off Workshop
150 Startups Kick-off Workshop150 Startups Kick-off Workshop
150 Startups Kick-off Workshop150Startups
 
Why unvalidated assumption is the enemy of good product
Why unvalidated assumption is the enemy of good productWhy unvalidated assumption is the enemy of good product
Why unvalidated assumption is the enemy of good productSeb Agertoft
 
Quality, Testing & Agile Methodologies
Quality, Testing & Agile MethodologiesQuality, Testing & Agile Methodologies
Quality, Testing & Agile MethodologiesJohan Hoberg
 
Introduction to lean & agile
Introduction to lean & agileIntroduction to lean & agile
Introduction to lean & agileJugoslav Petkovic
 
Book club INSPIRED How To Create Tech Products Customers Love
Book club INSPIRED How To Create Tech Products Customers LoveBook club INSPIRED How To Create Tech Products Customers Love
Book club INSPIRED How To Create Tech Products Customers LoveSEB
 
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8Optimizely
 
Fail Well, Pivot Fast: Product Experimentation for Continuous Discovery
Fail Well, Pivot Fast: Product Experimentation for Continuous DiscoveryFail Well, Pivot Fast: Product Experimentation for Continuous Discovery
Fail Well, Pivot Fast: Product Experimentation for Continuous DiscoveryAggregage
 
Agile Kaizen: Agile Product Management - Course Slides
Agile Kaizen: Agile Product Management - Course SlidesAgile Kaizen: Agile Product Management - Course Slides
Agile Kaizen: Agile Product Management - Course SlidesProyectalis / Improvement21
 
03 Prioritizing Responses for a DoE
03 Prioritizing Responses for a DoE 03 Prioritizing Responses for a DoE
03 Prioritizing Responses for a DoE Stefan Moser
 

Similar to Testing and Learning in Modern Times (20)

Huib Schoots Testing in modern times - a story about Quality and Value - Test...
Huib Schoots Testing in modern times - a story about Quality and Value - Test...Huib Schoots Testing in modern times - a story about Quality and Value - Test...
Huib Schoots Testing in modern times - a story about Quality and Value - Test...
 
Lean Business Validation experiments
Lean Business Validation experimentsLean Business Validation experiments
Lean Business Validation experiments
 
[Paul Holland] Trends in Software Testing
[Paul Holland] Trends in Software Testing[Paul Holland] Trends in Software Testing
[Paul Holland] Trends in Software Testing
 
Agile Product Management - Co-Training with Angel Medinilla (c)
Agile Product Management - Co-Training with Angel Medinilla (c)Agile Product Management - Co-Training with Angel Medinilla (c)
Agile Product Management - Co-Training with Angel Medinilla (c)
 
Change the conversation keynote StarWest 2015
Change the conversation keynote StarWest 2015Change the conversation keynote StarWest 2015
Change the conversation keynote StarWest 2015
 
2016.08.THAT Conference - GROWING NEW PRODUCTS - VALIDATING YOUR NEW PRODUCT ...
2016.08.THAT Conference - GROWING NEW PRODUCTS - VALIDATING YOUR NEW PRODUCT ...2016.08.THAT Conference - GROWING NEW PRODUCTS - VALIDATING YOUR NEW PRODUCT ...
2016.08.THAT Conference - GROWING NEW PRODUCTS - VALIDATING YOUR NEW PRODUCT ...
 
Experimentation for PMs: A Primer by Amazon Director of Product
Experimentation for PMs: A Primer by Amazon Director of ProductExperimentation for PMs: A Primer by Amazon Director of Product
Experimentation for PMs: A Primer by Amazon Director of Product
 
Intro to Product Discovery
Intro to Product DiscoveryIntro to Product Discovery
Intro to Product Discovery
 
I’m an Agile Test Manager: Do I really exist?
I’m an Agile Test Manager:Do I really exist?I’m an Agile Test Manager:Do I really exist?
I’m an Agile Test Manager: Do I really exist?
 
150 Startups Kick-off Workshop
150 Startups Kick-off Workshop150 Startups Kick-off Workshop
150 Startups Kick-off Workshop
 
Why unvalidated assumption is the enemy of good product
Why unvalidated assumption is the enemy of good productWhy unvalidated assumption is the enemy of good product
Why unvalidated assumption is the enemy of good product
 
Quality, Testing & Agile Methodologies
Quality, Testing & Agile MethodologiesQuality, Testing & Agile Methodologies
Quality, Testing & Agile Methodologies
 
Introduction to lean & agile
Introduction to lean & agileIntroduction to lean & agile
Introduction to lean & agile
 
EESS Day 1 - Justin Ludcke
EESS Day 1 - Justin LudckeEESS Day 1 - Justin Ludcke
EESS Day 1 - Justin Ludcke
 
Book club INSPIRED How To Create Tech Products Customers Love
Book club INSPIRED How To Create Tech Products Customers LoveBook club INSPIRED How To Create Tech Products Customers Love
Book club INSPIRED How To Create Tech Products Customers Love
 
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
How To Build a Winning Experimentation Program & Team | Optimizely ANZ Webinar 8
 
Fail Well, Pivot Fast: Product Experimentation for Continuous Discovery
Fail Well, Pivot Fast: Product Experimentation for Continuous DiscoveryFail Well, Pivot Fast: Product Experimentation for Continuous Discovery
Fail Well, Pivot Fast: Product Experimentation for Continuous Discovery
 
Agile Kaizen: Agile Product Management - Course Slides
Agile Kaizen: Agile Product Management - Course SlidesAgile Kaizen: Agile Product Management - Course Slides
Agile Kaizen: Agile Product Management - Course Slides
 
03 Prioritizing Responses for a DoE
03 Prioritizing Responses for a DoE 03 Prioritizing Responses for a DoE
03 Prioritizing Responses for a DoE
 
Adopting innovation
Adopting innovationAdopting innovation
Adopting innovation
 

More from Huib Schoots

A road to awesomeness
A road to awesomenessA road to awesomeness
A road to awesomenessHuib Schoots
 
Telling the testing story - Storytelling voor testers (DUTCH)
Telling the testing story - Storytelling voor testers (DUTCH)Telling the testing story - Storytelling voor testers (DUTCH)
Telling the testing story - Storytelling voor testers (DUTCH)Huib Schoots
 
Exploratory testing
Exploratory testingExploratory testing
Exploratory testingHuib Schoots
 
Thinking and working visually for software testers - Nordic Testing Days
Thinking and working visually for software testers - Nordic Testing DaysThinking and working visually for software testers - Nordic Testing Days
Thinking and working visually for software testers - Nordic Testing DaysHuib Schoots
 
Where words fail music speaks
Where words fail music speaksWhere words fail music speaks
Where words fail music speaksHuib Schoots
 
Succesful Testing The Continuous Delivery Process
Succesful Testing The Continuous Delivery ProcessSuccesful Testing The Continuous Delivery Process
Succesful Testing The Continuous Delivery ProcessHuib Schoots
 
Thinking and working visually for software testers
Thinking and working visually for software testersThinking and working visually for software testers
Thinking and working visually for software testersHuib Schoots
 
Mind maps tutorial Agile Testing Days
Mind maps tutorial Agile Testing DaysMind maps tutorial Agile Testing Days
Mind maps tutorial Agile Testing DaysHuib Schoots
 
Changing the context
Changing the contextChanging the context
Changing the contextHuib Schoots
 
Testnet JuBoCo boek introductie
Testnet JuBoCo boek introductieTestnet JuBoCo boek introductie
Testnet JuBoCo boek introductieHuib Schoots
 
Boost your testing power with Exploration
Boost your testing power with ExplorationBoost your testing power with Exploration
Boost your testing power with ExplorationHuib Schoots
 
So you think you can test?
So you think you can test?So you think you can test?
So you think you can test?Huib Schoots
 

More from Huib Schoots (13)

A road to awesomeness
A road to awesomenessA road to awesomeness
A road to awesomeness
 
Telling the testing story - Storytelling voor testers (DUTCH)
Telling the testing story - Storytelling voor testers (DUTCH)Telling the testing story - Storytelling voor testers (DUTCH)
Telling the testing story - Storytelling voor testers (DUTCH)
 
Exploratory testing
Exploratory testingExploratory testing
Exploratory testing
 
Thinking and working visually for software testers - Nordic Testing Days
Thinking and working visually for software testers - Nordic Testing DaysThinking and working visually for software testers - Nordic Testing Days
Thinking and working visually for software testers - Nordic Testing Days
 
Where words fail music speaks
Where words fail music speaksWhere words fail music speaks
Where words fail music speaks
 
Succesful Testing The Continuous Delivery Process
Succesful Testing The Continuous Delivery ProcessSuccesful Testing The Continuous Delivery Process
Succesful Testing The Continuous Delivery Process
 
Set your course
Set your courseSet your course
Set your course
 
Thinking and working visually for software testers
Thinking and working visually for software testersThinking and working visually for software testers
Thinking and working visually for software testers
 
Mind maps tutorial Agile Testing Days
Mind maps tutorial Agile Testing DaysMind maps tutorial Agile Testing Days
Mind maps tutorial Agile Testing Days
 
Changing the context
Changing the contextChanging the context
Changing the context
 
Testnet JuBoCo boek introductie
Testnet JuBoCo boek introductieTestnet JuBoCo boek introductie
Testnet JuBoCo boek introductie
 
Boost your testing power with Exploration
Boost your testing power with ExplorationBoost your testing power with Exploration
Boost your testing power with Exploration
 
So you think you can test?
So you think you can test?So you think you can test?
So you think you can test?
 

Recently uploaded

Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...soniya singh
 
Intelligent Home Wi-Fi Solutions | ThinkPalm
Intelligent Home Wi-Fi Solutions | ThinkPalmIntelligent Home Wi-Fi Solutions | ThinkPalm
Intelligent Home Wi-Fi Solutions | ThinkPalmSujith Sukumaran
 
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASEBATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASEOrtus Solutions, Corp
 
EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityNeo4j
 
The Evolution of Karaoke From Analog to App.pdf
The Evolution of Karaoke From Analog to App.pdfThe Evolution of Karaoke From Analog to App.pdf
The Evolution of Karaoke From Analog to App.pdfPower Karaoke
 
chapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptchapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptkotipi9215
 
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...Christina Lin
 
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio, Inc.
 
Salesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantSalesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantAxelRicardoTrocheRiq
 
React Server Component in Next.js by Hanief Utama
React Server Component in Next.js by Hanief UtamaReact Server Component in Next.js by Hanief Utama
React Server Component in Next.js by Hanief UtamaHanief Utama
 
Professional Resume Template for Software Developers
Professional Resume Template for Software DevelopersProfessional Resume Template for Software Developers
Professional Resume Template for Software DevelopersVinodh Ram
 
Asset Management Software - Infographic
Asset Management Software - InfographicAsset Management Software - Infographic
Asset Management Software - InfographicHr365.us smith
 
Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024Andreas Granig
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideChristina Lin
 
Unveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML DiagramsUnveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML DiagramsAhmed Mohamed
 
Cloud Data Center Network Construction - IEEE
Cloud Data Center Network Construction - IEEECloud Data Center Network Construction - IEEE
Cloud Data Center Network Construction - IEEEVICTOR MAESTRE RAMIREZ
 
software engineering Chapter 5 System modeling.pptx
software engineering Chapter 5 System modeling.pptxsoftware engineering Chapter 5 System modeling.pptx
software engineering Chapter 5 System modeling.pptxnada99848
 
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...stazi3110
 
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...gurkirankumar98700
 
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfGOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfAlina Yurenko
 

Recently uploaded (20)

Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
 
Intelligent Home Wi-Fi Solutions | ThinkPalm
Intelligent Home Wi-Fi Solutions | ThinkPalmIntelligent Home Wi-Fi Solutions | ThinkPalm
Intelligent Home Wi-Fi Solutions | ThinkPalm
 
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASEBATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASE
 
EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered Sustainability
 
The Evolution of Karaoke From Analog to App.pdf
The Evolution of Karaoke From Analog to App.pdfThe Evolution of Karaoke From Analog to App.pdf
The Evolution of Karaoke From Analog to App.pdf
 
chapter--4-software-project-planning.ppt
chapter--4-software-project-planning.pptchapter--4-software-project-planning.ppt
chapter--4-software-project-planning.ppt
 
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
ODSC - Batch to Stream workshop - integration of Apache Spark, Cassandra, Pos...
 
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
 
Salesforce Certified Field Service Consultant
Salesforce Certified Field Service ConsultantSalesforce Certified Field Service Consultant
Salesforce Certified Field Service Consultant
 
React Server Component in Next.js by Hanief Utama
React Server Component in Next.js by Hanief UtamaReact Server Component in Next.js by Hanief Utama
React Server Component in Next.js by Hanief Utama
 
Professional Resume Template for Software Developers
Professional Resume Template for Software DevelopersProfessional Resume Template for Software Developers
Professional Resume Template for Software Developers
 
Asset Management Software - Infographic
Asset Management Software - InfographicAsset Management Software - Infographic
Asset Management Software - Infographic
 
Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
 
Unveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML DiagramsUnveiling Design Patterns: A Visual Guide with UML Diagrams
Unveiling Design Patterns: A Visual Guide with UML Diagrams
 
Cloud Data Center Network Construction - IEEE
Cloud Data Center Network Construction - IEEECloud Data Center Network Construction - IEEE
Cloud Data Center Network Construction - IEEE
 
software engineering Chapter 5 System modeling.pptx
software engineering Chapter 5 System modeling.pptxsoftware engineering Chapter 5 System modeling.pptx
software engineering Chapter 5 System modeling.pptx
 
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
 
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
(Genuine) Escort Service Lucknow | Starting ₹,5K To @25k with A/C 🧑🏽‍❤️‍🧑🏻 89...
 
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfGOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
 

Testing and Learning in Modern Times

  • 1. Testing in modern times “a story about Quality and Value”
  • 3. Research& Development: Dealing with unknownunknowns Capture everything upfront vs. building new insights Customers don’t know what they want Cope with complexity, confusion, change, new insights and halfanswers So: We need to learn and to deal with risks!
  • 4. Testingand quality? Testing informs decisions about quality & risk Quality isvalue to people who matter Quality is NOT: conformance to requirements Quality is NOT: the best product possible Quality products solve the problem and are “good enough”
  • 6. Business caseof LEARNING? The question is: do you value learning?And if so: how much are you willingto pay? If you value it enough,you won'tdiscuss the price... But are thecosts justified? Or learn to live withoutit … withallrisks involved.
  • 8. Reduce cost oftesting? Focus on Testability! Learnability (*) learning (*)Learnability: not the old ISO9126definition My definition: how easy is it tolearn about the value and risks of a product/solution
  • 9. Testabilityyousay? Testability of a product is how easy it is to learn (read: test) by a particular team in a given context.
  • 10. Learning about testability 10 P’s of Testability Read more about this here: Team Guide to Software Testability - Better software through greater testability By Ash Winter and Rob Meaney (http://leanpub.com/softwaretestability)
  • 11. Automate everything? Automated checks provide binary answers to a question to which you already know the answer. We need a lot of checks to speed up development by detecting regression problems. Exploring can provide new insights into the product. Only people can provide this insight.
  • 12. Can everybodytest? Sure. The question is: how good do you want it to be? Most people do not like testing at all!And that is why they will never be good at it. Nor do they have time to learn these skills. We need smart people with "critical distance” to do skilled testing. People determined to find problems thatmatter. Problems asin: ”are there problems thatthreaten the value of the product or the on‐time successfuldelivery?” So are we stilltalkingabout testing? Or is it muchbroader?
  • 13. About critical distance We need a diversity in thinking: different mindsets Opportunity mindset Solve problems Ask howand whenquestions Problem mindset Search for problems Ask what if questions
  • 14. Learning in teams: it’s all about loops! Create learning loops (Plan-Do-Check-Act) in everything you do Team collaboration and skills are key: optimize your SDLC and processes Risks are a whole team responsibility Test your requirements & assumptions continuously Help programmers go faster: devand release pipelines, automated checks, codequality, measuring the right metrics Test enough (good is good enough): test & automation strategy! Oreven better: an integrated quality strategy based on risks Use tooling & automation in your exploration Mitigate “appropriate” risks by nottesting: monitoring, test in production, etc.
  • 15. Learning in teams: it’s all about loops! Focus onfast learning in ourteams: Whole team quality! So are westilltalkingabout testing?
  • 18. Referencesand more info Let’s stoptalking abouttesting,let’sstartthinking aboutvalue - http://www.huibschoots.nl/wordpress/?p=2763 Anne-MarieCharrett- Quality isaTeam Responsibility- https://youtu.be/mBC3ssLlJfQ Anne-MarieCharrett- ScrewTesting,Let’s Talk Quality - https://youtu.be/v4uw29pW73E TeamGuide toSoftwareTestability- http://leanpub.com/softwaretestability HeuristicsofSoftwareTestability - https://www.satisfice.com/download/heuristics-of-software-testability InterviewwithRob MeaneyonQualitycoachingroadshow- https://www.spreaker.com/show/quality-coaching TestabilityAsk Me Anything(Ash Winter) - https://www.ministryoftesting.com/dojo/lessons/testing-ask-me-anything-testability-ash-winter QualityEngineeringAsk me Anything (Anne-MarieCharrett)- https://www.ministryoftesting.com/dojo/series/testing-ask-me-anything/lessons/ask-me-anything-anne- marie-charrett-quality-engineering Rapidsoftwaretesting–https://www.rapid-software-testing.com Collectedlinks op mywebsite- http://www.huibschoots.nl/links

Editor's Notes

  1. Automation = adding more unreliable code to the stack of code you already have….
  2. Automation = adding more unreliable code to the stack of code you already have….
  3. Automation = adding more unreliable code to the stack of code you already have….
  4. Automation = adding more unreliable code to the stack of code you already have….