SlideShare a Scribd company logo
Eddy Bruin
A tale about Testing and Ignorance
He who knows not and knows not that he knows not, is a fool. Shun him!
He who knows not and knows that he knows not, is unlearned. Teach him!
He who knows and knows not that he knows, is asleep. Awaken him!
He who knows and knows that he knows, is enlightened. Follow him!
An Arab Proverb quoted by
Isabel Lady Burton (1831-1896) in
"The Life of Captain Sir Richard F. Burton"
Unknowledge
Missing knowledge
tool for acquiring knowledge
Unknowledge legacy
The 5 orders of ignorance
0OI = Lack of Ignorance
I (probably) know something. I have the answer and can explain it.
1OI = Lack of Knowledge
I don't know something, but I have a well formed question.
2OI = Lack of Awareness
I don't know that I don't know something. I have no idea what the right question is.
3OI = Lack of Process
I don't know a suitably way to find out I don't know that I don't know something.
I have no clue how to find the right idea's to search for the right question.
4OI = Meta-ignorance
I don't know about the Five Orders of Ignorance.
Let’s play a game
Ignorance
Time
Oops!
Oops!
Oops!
Ignorance
Time
Learning comes from
experiencing the unexpected
Ignorance is the single greatest
impediment to throughput
Source: Dan North - Introducing deliberate discovery
(1879 – 1955)
Which he said in 1994
Deliberate discovery practices
“Exploratory testing is simultaneous
learning, test design, and test execution.”
James Bach, 1995
Test techniques improve result
Immediate investigation gives most information
Get to know the system
A definition of exploratory testing
Where to start?
Explore it!
https://pragprog.com/book/ehxta/explore-it
RST
http://www.satisfice.com/info_rst.shtml
Little black book on test design
http://www.thetesteye.com/papers/TheLittleBlackBookOnTestDesign.pdf
Bug Hunts
http://www.ministryoftesting.com/2014/05/bughunts/
Exploratory testing resources
http://www.developsense.com/resources.html#exploratory_testing
Hey, I just met you
And this is crazy
So here’s my twitter
So tweet me maybe?!
@eddybruin
Big thanks to these guys!
Dan North – Deliberate discovery
http://goo.gl/ke485
Philip Armour – The five orders of ignorance
http://goo.gl/LIqn6Y
Alan Page – Testers and the order of ignorance
http://goo.gl/cpOGTv
Or me: eddy@loopforward.nl

More Related Content

What's hot

Git with bitbucket
Git with bitbucketGit with bitbucket
Git with bitbucketSumin Byeon
 
Introduction to Git and GitHub Part 1
Introduction to Git and GitHub Part 1Introduction to Git and GitHub Part 1
Introduction to Git and GitHub Part 1
Omar Fathy
 
Introduction to Git/Github - A beginner's guide
Introduction to Git/Github - A beginner's guideIntroduction to Git/Github - A beginner's guide
Introduction to Git/Github - A beginner's guide
Rohit Arora
 
Starting with Git & GitHub
Starting with Git & GitHubStarting with Git & GitHub
Starting with Git & GitHub
Nicolás Tourné
 
Git and git flow
Git and git flowGit and git flow
Git and git flow
Fran García
 
Git basic
Git basicGit basic
Git basic
Emran Ul Hadi
 
Git Pull Requests
Git Pull RequestsGit Pull Requests
Git Pull Requests
Callon Campbell
 
Introduction to GitHub Actions
Introduction to GitHub ActionsIntroduction to GitHub Actions
Introduction to GitHub Actions
Bo-Yi Wu
 
Presentacion git
Presentacion gitPresentacion git
Presentacion git
Ignacio Martín
 
Git n git hub
Git n git hubGit n git hub
Git n git hub
Jiwon Baek
 
Python Collections Tutorial | Edureka
Python Collections Tutorial | EdurekaPython Collections Tutorial | Edureka
Python Collections Tutorial | Edureka
Edureka!
 
Intro to Git, GitHub, and BitBucket
Intro to Git, GitHub, and BitBucketIntro to Git, GitHub, and BitBucket
Git Branching – the battle of the ages
Git Branching – the battle of the agesGit Branching – the battle of the ages
Git Branching – the battle of the ages
Jasmin Fluri
 
GitHub Presentation
GitHub PresentationGitHub Presentation
GitHub Presentation
BrianSchilder
 
Python Class | Python Programming | Python Tutorial | Edureka
Python Class | Python Programming | Python Tutorial | EdurekaPython Class | Python Programming | Python Tutorial | Edureka
Python Class | Python Programming | Python Tutorial | Edureka
Edureka!
 
Difference between gitlab vs github vs bitbucket
Difference between gitlab vs github vs bitbucketDifference between gitlab vs github vs bitbucket
Difference between gitlab vs github vs bitbucket
Acodez IT Solutions
 
Git Started With Git
Git Started With GitGit Started With Git
Git Started With Git
Nick Quaranto
 
Introduction to github slideshare
Introduction to github slideshareIntroduction to github slideshare
Introduction to github slideshare
Rakesh Sukumar
 
工程師必備第一工具 - Git
工程師必備第一工具 - Git工程師必備第一工具 - Git
工程師必備第一工具 - Git
Alan Tsai
 
Formation autour de git et git lab
Formation autour de git et git labFormation autour de git et git lab
Formation autour de git et git lab
Abdelghani Azri
 

What's hot (20)

Git with bitbucket
Git with bitbucketGit with bitbucket
Git with bitbucket
 
Introduction to Git and GitHub Part 1
Introduction to Git and GitHub Part 1Introduction to Git and GitHub Part 1
Introduction to Git and GitHub Part 1
 
Introduction to Git/Github - A beginner's guide
Introduction to Git/Github - A beginner's guideIntroduction to Git/Github - A beginner's guide
Introduction to Git/Github - A beginner's guide
 
Starting with Git & GitHub
Starting with Git & GitHubStarting with Git & GitHub
Starting with Git & GitHub
 
Git and git flow
Git and git flowGit and git flow
Git and git flow
 
Git basic
Git basicGit basic
Git basic
 
Git Pull Requests
Git Pull RequestsGit Pull Requests
Git Pull Requests
 
Introduction to GitHub Actions
Introduction to GitHub ActionsIntroduction to GitHub Actions
Introduction to GitHub Actions
 
Presentacion git
Presentacion gitPresentacion git
Presentacion git
 
Git n git hub
Git n git hubGit n git hub
Git n git hub
 
Python Collections Tutorial | Edureka
Python Collections Tutorial | EdurekaPython Collections Tutorial | Edureka
Python Collections Tutorial | Edureka
 
Intro to Git, GitHub, and BitBucket
Intro to Git, GitHub, and BitBucketIntro to Git, GitHub, and BitBucket
Intro to Git, GitHub, and BitBucket
 
Git Branching – the battle of the ages
Git Branching – the battle of the agesGit Branching – the battle of the ages
Git Branching – the battle of the ages
 
GitHub Presentation
GitHub PresentationGitHub Presentation
GitHub Presentation
 
Python Class | Python Programming | Python Tutorial | Edureka
Python Class | Python Programming | Python Tutorial | EdurekaPython Class | Python Programming | Python Tutorial | Edureka
Python Class | Python Programming | Python Tutorial | Edureka
 
Difference between gitlab vs github vs bitbucket
Difference between gitlab vs github vs bitbucketDifference between gitlab vs github vs bitbucket
Difference between gitlab vs github vs bitbucket
 
Git Started With Git
Git Started With GitGit Started With Git
Git Started With Git
 
Introduction to github slideshare
Introduction to github slideshareIntroduction to github slideshare
Introduction to github slideshare
 
工程師必備第一工具 - Git
工程師必備第一工具 - Git工程師必備第一工具 - Git
工程師必備第一工具 - Git
 
Formation autour de git et git lab
Formation autour de git et git labFormation autour de git et git lab
Formation autour de git et git lab
 

Similar to 5 orders of ignorance - A tale about testing and ignorance

Human sciences introduction no build
Human sciences introduction no buildHuman sciences introduction no build
Human sciences introduction no build
Nothingnerdy
 
Black and white equal grey
Black and white equal greyBlack and white equal grey
Black and white equal grey
The Evans Group LLC
 
Common Sense 101 - so much to learn about CS
Common Sense 101 - so much to learn about CSCommon Sense 101 - so much to learn about CS
Common Sense 101 - so much to learn about CS
Dinesh O Bareja
 
Weaving straw baskets
Weaving straw basketsWeaving straw baskets
Weaving straw baskets
The Evans Group LLC
 
Becoming a Hero in School: Overcoming the Fear of Learning
Becoming a Hero in School: Overcoming the Fear of LearningBecoming a Hero in School: Overcoming the Fear of Learning
Becoming a Hero in School: Overcoming the Fear of Learning
bbigelow
 
What is knowledge 2016 revision jtb conditions not being necessary
What is knowledge 2016 revision   jtb conditions not being necessaryWhat is knowledge 2016 revision   jtb conditions not being necessary
What is knowledge 2016 revision jtb conditions not being necessary
Jon Bradshaw
 
Social understanding in autism
Social understanding in autismSocial understanding in autism
Social understanding in autism
MikeBlamires
 
Mba year 1_571216_nol
Mba year 1_571216_nolMba year 1_571216_nol
Mba year 1_571216_nolrevathigiri
 
Projective techniquesby arif raza The university of Lahore
Projective techniquesby arif raza  The university of LahoreProjective techniquesby arif raza  The university of Lahore
Projective techniquesby arif raza The university of Lahore
Arif Raza
 
Exploring Communication with the Perplexing Other - When Introverts and Extra...
Exploring Communication with the Perplexing Other - When Introverts and Extra...Exploring Communication with the Perplexing Other - When Introverts and Extra...
Exploring Communication with the Perplexing Other - When Introverts and Extra...
Leslie Boyter
 
Davenport, Iowa - August 2018
Davenport, Iowa - August 2018Davenport, Iowa - August 2018
Davenport, Iowa - August 2018
Brian Housand
 
The Five Whys - Are We Doing it Wrong?
The Five Whys - Are We Doing it Wrong?The Five Whys - Are We Doing it Wrong?
The Five Whys - Are We Doing it Wrong?
Mike Rother
 
5 things 22nd january
5 things   22nd january5 things   22nd january
5 things 22nd january
Andy Irvine
 
Introdutory presentation on Reason for Tok
Introdutory presentation on Reason for TokIntrodutory presentation on Reason for Tok
Introdutory presentation on Reason for Tokplangdale
 
Tok intro
Tok introTok intro
Tok intro
Ayca Turkkan
 
SE 3 Questions
SE 3 QuestionsSE 3 Questions
SE 3 Questions
Richard Chamberlain
 

Similar to 5 orders of ignorance - A tale about testing and ignorance (20)

Human sciences introduction no build
Human sciences introduction no buildHuman sciences introduction no build
Human sciences introduction no build
 
Black and white equal grey
Black and white equal greyBlack and white equal grey
Black and white equal grey
 
Logic
LogicLogic
Logic
 
Common Sense 101 - so much to learn about CS
Common Sense 101 - so much to learn about CSCommon Sense 101 - so much to learn about CS
Common Sense 101 - so much to learn about CS
 
Weaving straw baskets
Weaving straw basketsWeaving straw baskets
Weaving straw baskets
 
Becoming a Hero in School: Overcoming the Fear of Learning
Becoming a Hero in School: Overcoming the Fear of LearningBecoming a Hero in School: Overcoming the Fear of Learning
Becoming a Hero in School: Overcoming the Fear of Learning
 
What is knowledge 2016 revision jtb conditions not being necessary
What is knowledge 2016 revision   jtb conditions not being necessaryWhat is knowledge 2016 revision   jtb conditions not being necessary
What is knowledge 2016 revision jtb conditions not being necessary
 
Social understanding in autism
Social understanding in autismSocial understanding in autism
Social understanding in autism
 
Mba year 1_571216_nol
Mba year 1_571216_nolMba year 1_571216_nol
Mba year 1_571216_nol
 
Projective techniquesby arif raza The university of Lahore
Projective techniquesby arif raza  The university of LahoreProjective techniquesby arif raza  The university of Lahore
Projective techniquesby arif raza The university of Lahore
 
Creativity
CreativityCreativity
Creativity
 
Exploring Communication with the Perplexing Other - When Introverts and Extra...
Exploring Communication with the Perplexing Other - When Introverts and Extra...Exploring Communication with the Perplexing Other - When Introverts and Extra...
Exploring Communication with the Perplexing Other - When Introverts and Extra...
 
Davenport, Iowa - August 2018
Davenport, Iowa - August 2018Davenport, Iowa - August 2018
Davenport, Iowa - August 2018
 
Thinking power
Thinking powerThinking power
Thinking power
 
Step 07
Step 07Step 07
Step 07
 
The Five Whys - Are We Doing it Wrong?
The Five Whys - Are We Doing it Wrong?The Five Whys - Are We Doing it Wrong?
The Five Whys - Are We Doing it Wrong?
 
5 things 22nd january
5 things   22nd january5 things   22nd january
5 things 22nd january
 
Introdutory presentation on Reason for Tok
Introdutory presentation on Reason for TokIntrodutory presentation on Reason for Tok
Introdutory presentation on Reason for Tok
 
Tok intro
Tok introTok intro
Tok intro
 
SE 3 Questions
SE 3 QuestionsSE 3 Questions
SE 3 Questions
 

More from Eddy Bruin

There is NO test automation
There is NO test automationThere is NO test automation
There is NO test automation
Eddy Bruin
 
Yvonne and others - Mobile test automation the ING mobile app
Yvonne and others - Mobile test automation the ING mobile appYvonne and others - Mobile test automation the ING mobile app
Yvonne and others - Mobile test automation the ING mobile app
Eddy Bruin
 
Learning by gaming
Learning by gamingLearning by gaming
Learning by gaming
Eddy Bruin
 
Van glazen bol naar raam - Monitor je product
Van glazen bol naar raam - Monitor je product Van glazen bol naar raam - Monitor je product
Van glazen bol naar raam - Monitor je product
Eddy Bruin
 
Testers know your customers - 8 hands on tips
Testers know your customers - 8 hands on tipsTesters know your customers - 8 hands on tips
Testers know your customers - 8 hands on tips
Eddy Bruin
 
The importance of Usability Testing: Paper prototyping
The importance of Usability Testing: Paper prototypingThe importance of Usability Testing: Paper prototyping
The importance of Usability Testing: Paper prototyping
Eddy Bruin
 
What testers can learn from brewing beer - Brewing beer the agile way
What testers can learn from brewing beer - Brewing beer the agile wayWhat testers can learn from brewing beer - Brewing beer the agile way
What testers can learn from brewing beer - Brewing beer the agile way
Eddy Bruin
 
Testers know thy customers - A talk on verifying business ideas using analyti...
Testers know thy customers - A talk on verifying business ideas using analyti...Testers know thy customers - A talk on verifying business ideas using analyti...
Testers know thy customers - A talk on verifying business ideas using analyti...
Eddy Bruin
 
Testing a new mobile world - Eddy Bruin
Testing a new mobile world - Eddy BruinTesting a new mobile world - Eddy Bruin
Testing a new mobile world - Eddy Bruin
Eddy Bruin
 

More from Eddy Bruin (9)

There is NO test automation
There is NO test automationThere is NO test automation
There is NO test automation
 
Yvonne and others - Mobile test automation the ING mobile app
Yvonne and others - Mobile test automation the ING mobile appYvonne and others - Mobile test automation the ING mobile app
Yvonne and others - Mobile test automation the ING mobile app
 
Learning by gaming
Learning by gamingLearning by gaming
Learning by gaming
 
Van glazen bol naar raam - Monitor je product
Van glazen bol naar raam - Monitor je product Van glazen bol naar raam - Monitor je product
Van glazen bol naar raam - Monitor je product
 
Testers know your customers - 8 hands on tips
Testers know your customers - 8 hands on tipsTesters know your customers - 8 hands on tips
Testers know your customers - 8 hands on tips
 
The importance of Usability Testing: Paper prototyping
The importance of Usability Testing: Paper prototypingThe importance of Usability Testing: Paper prototyping
The importance of Usability Testing: Paper prototyping
 
What testers can learn from brewing beer - Brewing beer the agile way
What testers can learn from brewing beer - Brewing beer the agile wayWhat testers can learn from brewing beer - Brewing beer the agile way
What testers can learn from brewing beer - Brewing beer the agile way
 
Testers know thy customers - A talk on verifying business ideas using analyti...
Testers know thy customers - A talk on verifying business ideas using analyti...Testers know thy customers - A talk on verifying business ideas using analyti...
Testers know thy customers - A talk on verifying business ideas using analyti...
 
Testing a new mobile world - Eddy Bruin
Testing a new mobile world - Eddy BruinTesting a new mobile world - Eddy Bruin
Testing a new mobile world - Eddy Bruin
 

Recently uploaded

DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
Kari Kakkonen
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
Sri Ambati
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance
 
Quantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIsQuantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIs
Vlad Stirbu
 
By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024
Pierluigi Pugliese
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
UiPathCommunity
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
ControlCase
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
Ralf Eggert
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
91mobiles
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Albert Hoitingh
 
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
UiPathCommunity
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Paige Cruz
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
Alpen-Adria-Universität
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
sonjaschweigert1
 
Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
Peter Spielvogel
 

Recently uploaded (20)

DevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA ConnectDevOps and Testing slides at DASA Connect
DevOps and Testing slides at DASA Connect
 
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
GenAISummit 2024 May 28 Sri Ambati Keynote: AGI Belongs to The Community in O...
 
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdfFIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
FIDO Alliance Osaka Seminar: The WebAuthn API and Discoverable Credentials.pdf
 
Quantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIsQuantum Computing: Current Landscape and the Future Role of APIs
Quantum Computing: Current Landscape and the Future Role of APIs
 
By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024By Design, not by Accident - Agile Venture Bolzano 2024
By Design, not by Accident - Agile Venture Bolzano 2024
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
FIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdfFIDO Alliance Osaka Seminar: Overview.pdf
FIDO Alliance Osaka Seminar: Overview.pdf
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
PCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase TeamPCI PIN Basics Webinar from the Controlcase Team
PCI PIN Basics Webinar from the Controlcase Team
 
PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)PHP Frameworks: I want to break free (IPC Berlin 2024)
PHP Frameworks: I want to break free (IPC Berlin 2024)
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024
 
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdfObservability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
Observability Concepts EVERY Developer Should Know -- DeveloperWeek Europe.pdf
 
Video Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the FutureVideo Streaming: Then, Now, and in the Future
Video Streaming: Then, Now, and in the Future
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
 
Assure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyesAssure Contact Center Experiences for Your Customers With ThousandEyes
Assure Contact Center Experiences for Your Customers With ThousandEyes
 
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfSAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdf
 

5 orders of ignorance - A tale about testing and ignorance

  • 1. Eddy Bruin A tale about Testing and Ignorance
  • 2.
  • 3.
  • 4.
  • 5. He who knows not and knows not that he knows not, is a fool. Shun him! He who knows not and knows that he knows not, is unlearned. Teach him! He who knows and knows not that he knows, is asleep. Awaken him! He who knows and knows that he knows, is enlightened. Follow him! An Arab Proverb quoted by Isabel Lady Burton (1831-1896) in "The Life of Captain Sir Richard F. Burton"
  • 6. Unknowledge Missing knowledge tool for acquiring knowledge Unknowledge legacy
  • 7. The 5 orders of ignorance 0OI = Lack of Ignorance I (probably) know something. I have the answer and can explain it. 1OI = Lack of Knowledge I don't know something, but I have a well formed question. 2OI = Lack of Awareness I don't know that I don't know something. I have no idea what the right question is. 3OI = Lack of Process I don't know a suitably way to find out I don't know that I don't know something. I have no clue how to find the right idea's to search for the right question. 4OI = Meta-ignorance I don't know about the Five Orders of Ignorance.
  • 11. Learning comes from experiencing the unexpected Ignorance is the single greatest impediment to throughput Source: Dan North - Introducing deliberate discovery
  • 12. (1879 – 1955) Which he said in 1994
  • 14. “Exploratory testing is simultaneous learning, test design, and test execution.” James Bach, 1995 Test techniques improve result Immediate investigation gives most information Get to know the system A definition of exploratory testing
  • 15. Where to start? Explore it! https://pragprog.com/book/ehxta/explore-it RST http://www.satisfice.com/info_rst.shtml Little black book on test design http://www.thetesteye.com/papers/TheLittleBlackBookOnTestDesign.pdf Bug Hunts http://www.ministryoftesting.com/2014/05/bughunts/ Exploratory testing resources http://www.developsense.com/resources.html#exploratory_testing
  • 16. Hey, I just met you And this is crazy So here’s my twitter So tweet me maybe?! @eddybruin Big thanks to these guys! Dan North – Deliberate discovery http://goo.gl/ke485 Philip Armour – The five orders of ignorance http://goo.gl/LIqn6Y Alan Page – Testers and the order of ignorance http://goo.gl/cpOGTv Or me: eddy@loopforward.nl