SlideShare a Scribd company logo
Viktor Slavchev &
The Testing troll
Siteground
The “worst” practices of software testing
About me
• Senior QA @ Siteground Hosting
• Wooden philosopher at Pragmatic
(part time)
• Blogger @ mrslavchev.com(long
time ago in a galaxy far far away)
• True believer that testing is a
human centric activity
• A mythical testing creature
• Graduated the technical
university of Trolandia
• Certified as SHGMCNGTT -
Super Hyper Giga Mega
Certified Ninja Guru Testing
troll
• Book author
About The testing troll
And the book:
• Absolute bestseller
• Sold more copies than “50
shades of gray” in Trolandia
• “Absolutely mind-blowing”
New York Times
• “The troll is strong with this
one”
Darth Vader
Best practice#1 - Rely on requirements
and documentation
Worst practice #1:
Learn about the real testing oracles
instead
Testing oracles can benefit from:
Feelings and mental models
• It starts as a feeling
• Not sufficient for a
bug report
Artifacts: documents, designs,
requirements, etc.
Experience in:
• The domain
• General testing
• Software industry
Conference
• Developers
• Other testers
• Clients
• Anyone who
matters
Example 1: Reference oracle
• External application
• Other platform
• Correctness presumed
Example 2: Self-verifying data as an
oracle
Desired response: Credit card #:
000: Approved 4470330769941000
010: Partially Approved 4658512425423010
110: Insufficient Funds 4488282659650110
Example 3: Constraints oracle
Example: VAT number
BG123456789
• Length
• Country index
• Spaces
Source:The Oracle Problem and the Teaching of Software
Testing
Best practice#2 - Do regression
testing by executing your old tests
Regression testing != repetitive testing
Repetitive testing is the reason why
“others” see testing like this...
Worst practice #2:
Regression checks and focus on tests
that reveal new information
Regress - verb
• to move backward; go back.
• to revert to an earlier or less advanced
state or form
Regression bug:
• Bug causing regress in
quality
Regression testing:
• Testing to expose
regression bugs
Regression check:
• Building part of a test
• Definite answer
• Small and easy to
manage
Focus on information
Best practice#3 - Automationion testing is
the best, “manual” testing sucks
Quote from J. Kohl - Tap into mobile
application testing
Ideas that will produce
bug-free software:
• C++ STL
• OOP
• Agile
• TDD
• Test automation
Quote from J. Kohl - Tap into mobile
application testing
“Each of these were also used to tell me
that testers would no longer be
needed on software projects. So far, I
am fifteen years in and I haven’t seen
anything bug free yet.”
Can a testing tool produce better
testers?
Answer:
How to make efficient automation that
provides value to testing?
The answer is:
Worst practice #3:
Use automation as a tool
• To extend your abilities
• Not to replace you
completely
• To ask the right
questions
Automation is great for:
• Confirmation /
Verification
• Low level checking
• Precision
• Functional correctness
• Solving machine
problems
But automation sucks when dealing
with:
• Exploration
• Unanticipated risks
• Qualitative evaluation
• Open ended questions
• Solving human
problems
Source:Things Could Get Worse-
Michael Bolton
Source: The non-manual, unautomated tester
Best practice#4 - Assure quality
Quality is not a resource
Quality != testing
Worst practice #4:
Provide information about risks
• Risk based testing -
focus testing to explore
potential risks
“Nightmare newspaper headings”
• You missed a critical
bug in production
• It caused your
company a huge
financial loss
• What would it be?
• Pre-mortem - imagining a failure and
working backwards in order to
determine the possible risks.
Benefits:
• Evaluation of risks
• Business perspective
• Prioritization
Best practice#5 - Follow best practices
Worst practice #5:
Be always alert and aware of your
context
• What would be your
approach in 3 different
contexts?
Context #1: Weather app
• You’re an outsourced
testing expert
• Working for a start-up
• Low on budget
• Behind schedule
Context #2: Medical software
• High precision is a must
• Human lives might
depend on it
• Regulatory compliance
of testing
Context #3: Court case
• Bug caused an injury
• You are independant
expert
• On a case for negligence
in testing
Questions:
• How exhaustive will be
your testing in each
context?
• Will bug-hunting be your
highest priority?
• Will you have the same
strategy of testing?
Conclusion
• No best practices!
• “We are not into the
belief business” J.Bach
• In order to be a good
tester, you have to be a
professional sceptic
Thank you very much!
… And don’t forget to Rock ‘n Troll
Image credits:
Too lazy to post them all.
Image credits go to the almighty internet, I don’t own
any of the images included in this presentation, except
the ones created by me, linked to my blog.
STIONS?
ANY

More Related Content

What's hot

Exploring with Automation
Exploring with AutomationExploring with Automation
Exploring with Automation
James Thomas
 
Testing All the Way Down, and Other Directions
Testing All the Way Down, and Other DirectionsTesting All the Way Down, and Other Directions
Testing All the Way Down, and Other Directions
James Thomas
 
How to Test Anything
How to Test AnythingHow to Test Anything
How to Test Anything
James Thomas
 
Santa Barbara Agile: Exploratory Testing Explained and Experienced
Santa Barbara Agile: Exploratory Testing Explained and ExperiencedSanta Barbara Agile: Exploratory Testing Explained and Experienced
Santa Barbara Agile: Exploratory Testing Explained and Experienced
Maaret Pyhäjärvi
 
Intro to TDD
Intro to TDDIntro to TDD
Intro to TDD
Jason Nocks
 
Bug-Free Software? Go For It!
Bug-Free Software? Go For It!Bug-Free Software? Go For It!
Bug-Free Software? Go For It!
James Thomas
 
Agile Testers: Becoming a key asset for your team
Agile Testers: Becoming a key asset for your teamAgile Testers: Becoming a key asset for your team
Agile Testers: Becoming a key asset for your team
gojkoadzic
 
TestIstanbul May 2013 Keynote Experiences With Exploratory Testing
TestIstanbul May 2013 Keynote Experiences With Exploratory TestingTestIstanbul May 2013 Keynote Experiences With Exploratory Testing
TestIstanbul May 2013 Keynote Experiences With Exploratory Testing
Alan Richardson
 
A Context-Driven Approach to Automation in Testing
A Context-Driven Approach to Automation in TestingA Context-Driven Approach to Automation in Testing
A Context-Driven Approach to Automation in Testing
BugRaptors
 
A Taste of Exploratory Testing
A Taste of Exploratory TestingA Taste of Exploratory Testing
A Taste of Exploratory Testing
Anne-Marie Charrett
 
Things Could Get Worse: Ideas About Regression Testing
Things Could Get Worse: Ideas About Regression TestingThings Could Get Worse: Ideas About Regression Testing
Things Could Get Worse: Ideas About Regression Testing
TechWell
 
Exploratory Testing in an Agile Context
Exploratory Testing in an Agile ContextExploratory Testing in an Agile Context
Exploratory Testing in an Agile ContextElisabeth Hendrickson
 
Claudiu Draghia ITEM 2018
Claudiu Draghia ITEM 2018Claudiu Draghia ITEM 2018
Claudiu Draghia ITEM 2018
ITEM
 
Agile2015: Explore with Intent - Self-Management
Agile2015: Explore with Intent - Self-ManagementAgile2015: Explore with Intent - Self-Management
Agile2015: Explore with Intent - Self-Management
Maaret Pyhäjärvi
 
Agile Testing Days 2014 Keynote - Helping Testers Add Value on Agile Projects
Agile Testing Days 2014 Keynote - Helping Testers Add Value on Agile ProjectsAgile Testing Days 2014 Keynote - Helping Testers Add Value on Agile Projects
Agile Testing Days 2014 Keynote - Helping Testers Add Value on Agile Projects
Alan Richardson
 
Confessions of an Accidental Security Tester
Confessions of an Accidental Security TesterConfessions of an Accidental Security Tester
Confessions of an Accidental Security Tester
Alan Richardson
 
Testing in production
Testing in productionTesting in production
Testing in production
Jyrki Pulliainen
 
Debugging Design [EN]
Debugging Design [EN]Debugging Design [EN]
Debugging Design [EN]
Magdalena Ostoja-Chyżyńska
 
Usability Testing & You
Usability Testing & YouUsability Testing & You
Usability Testing & You
Cate Kompare
 
The Art of Questioning to improve Software Testing, Agile and Automating
The Art of Questioning to improve Software Testing, Agile and AutomatingThe Art of Questioning to improve Software Testing, Agile and Automating
The Art of Questioning to improve Software Testing, Agile and Automating
Alan Richardson
 

What's hot (20)

Exploring with Automation
Exploring with AutomationExploring with Automation
Exploring with Automation
 
Testing All the Way Down, and Other Directions
Testing All the Way Down, and Other DirectionsTesting All the Way Down, and Other Directions
Testing All the Way Down, and Other Directions
 
How to Test Anything
How to Test AnythingHow to Test Anything
How to Test Anything
 
Santa Barbara Agile: Exploratory Testing Explained and Experienced
Santa Barbara Agile: Exploratory Testing Explained and ExperiencedSanta Barbara Agile: Exploratory Testing Explained and Experienced
Santa Barbara Agile: Exploratory Testing Explained and Experienced
 
Intro to TDD
Intro to TDDIntro to TDD
Intro to TDD
 
Bug-Free Software? Go For It!
Bug-Free Software? Go For It!Bug-Free Software? Go For It!
Bug-Free Software? Go For It!
 
Agile Testers: Becoming a key asset for your team
Agile Testers: Becoming a key asset for your teamAgile Testers: Becoming a key asset for your team
Agile Testers: Becoming a key asset for your team
 
TestIstanbul May 2013 Keynote Experiences With Exploratory Testing
TestIstanbul May 2013 Keynote Experiences With Exploratory TestingTestIstanbul May 2013 Keynote Experiences With Exploratory Testing
TestIstanbul May 2013 Keynote Experiences With Exploratory Testing
 
A Context-Driven Approach to Automation in Testing
A Context-Driven Approach to Automation in TestingA Context-Driven Approach to Automation in Testing
A Context-Driven Approach to Automation in Testing
 
A Taste of Exploratory Testing
A Taste of Exploratory TestingA Taste of Exploratory Testing
A Taste of Exploratory Testing
 
Things Could Get Worse: Ideas About Regression Testing
Things Could Get Worse: Ideas About Regression TestingThings Could Get Worse: Ideas About Regression Testing
Things Could Get Worse: Ideas About Regression Testing
 
Exploratory Testing in an Agile Context
Exploratory Testing in an Agile ContextExploratory Testing in an Agile Context
Exploratory Testing in an Agile Context
 
Claudiu Draghia ITEM 2018
Claudiu Draghia ITEM 2018Claudiu Draghia ITEM 2018
Claudiu Draghia ITEM 2018
 
Agile2015: Explore with Intent - Self-Management
Agile2015: Explore with Intent - Self-ManagementAgile2015: Explore with Intent - Self-Management
Agile2015: Explore with Intent - Self-Management
 
Agile Testing Days 2014 Keynote - Helping Testers Add Value on Agile Projects
Agile Testing Days 2014 Keynote - Helping Testers Add Value on Agile ProjectsAgile Testing Days 2014 Keynote - Helping Testers Add Value on Agile Projects
Agile Testing Days 2014 Keynote - Helping Testers Add Value on Agile Projects
 
Confessions of an Accidental Security Tester
Confessions of an Accidental Security TesterConfessions of an Accidental Security Tester
Confessions of an Accidental Security Tester
 
Testing in production
Testing in productionTesting in production
Testing in production
 
Debugging Design [EN]
Debugging Design [EN]Debugging Design [EN]
Debugging Design [EN]
 
Usability Testing & You
Usability Testing & YouUsability Testing & You
Usability Testing & You
 
The Art of Questioning to improve Software Testing, Agile and Automating
The Art of Questioning to improve Software Testing, Agile and AutomatingThe Art of Questioning to improve Software Testing, Agile and Automating
The Art of Questioning to improve Software Testing, Agile and Automating
 

Similar to Worst practices in software testing by the Testing troll

10 signs your testing is not enough
10 signs your testing is not enough10 signs your testing is not enough
10 signs your testing is not enough
SQALab
 
Dunning-Krueger Effect in Software Testing
Dunning-Krueger Effect in Software TestingDunning-Krueger Effect in Software Testing
Dunning-Krueger Effect in Software Testing
Mikhail Pavlov
 
Software testing
Software testingSoftware testing
Software testing
Nico Heidtke
 
A Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software TestingA Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software TestingTechWell
 
A Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software TestingA Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software Testing
TechWell
 
Exploratory Testing Explained
Exploratory Testing ExplainedExploratory Testing Explained
Exploratory Testing Explained
TechWell
 
How did i miss that bug rtc
How did i miss that bug rtcHow did i miss that bug rtc
How did i miss that bug rtc
GerieOwen
 
Quality Spy Overview
Quality Spy OverviewQuality Spy Overview
Quality Spy Overview
AndreasKleffel
 
A Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software TestingA Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software Testing
TechWell
 
Learn Learning + Prototype Testing
Learn Learning + Prototype TestingLearn Learning + Prototype Testing
Learn Learning + Prototype Testing
Dave Hora
 
Simon Peter Schrjver: Pair Testing
Simon Peter Schrjver: Pair TestingSimon Peter Schrjver: Pair Testing
Simon Peter Schrjver: Pair Testing
Anna Royzman
 
! Testing for agile teams
! Testing for agile teams! Testing for agile teams
! Testing for agile teams
Dennis Popov
 
Tester Challenges in Agile ?
Tester Challenges in Agile ?Tester Challenges in Agile ?
Tester Challenges in Agile ?alind tiwari
 
A Software Testing Intro
A Software Testing IntroA Software Testing Intro
A Software Testing Intro
Evozon Test Lab
 
Exploratory testing
Exploratory testingExploratory testing
Exploratory testingISsoft
 
Fundamentals_of_Software_testing.pptx
Fundamentals_of_Software_testing.pptxFundamentals_of_Software_testing.pptx
Fundamentals_of_Software_testing.pptx
MusaBashir9
 
Agile testingandautomation
Agile testingandautomationAgile testingandautomation
Agile testingandautomation
jeisner
 
Exploratory testing
Exploratory testingExploratory testing
Exploratory testing
Spoorthi Sham
 
01 software testing_introduction
01 software testing_introduction01 software testing_introduction
01 software testing_introduction
ManishJha237
 

Similar to Worst practices in software testing by the Testing troll (20)

10 signs your testing is not enough
10 signs your testing is not enough10 signs your testing is not enough
10 signs your testing is not enough
 
Dunning-Krueger Effect in Software Testing
Dunning-Krueger Effect in Software TestingDunning-Krueger Effect in Software Testing
Dunning-Krueger Effect in Software Testing
 
Software testing
Software testingSoftware testing
Software testing
 
A Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software TestingA Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software Testing
 
A Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software TestingA Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software Testing
 
Exploratory Testing Explained
Exploratory Testing ExplainedExploratory Testing Explained
Exploratory Testing Explained
 
How did i miss that bug rtc
How did i miss that bug rtcHow did i miss that bug rtc
How did i miss that bug rtc
 
Quality Spy Overview
Quality Spy OverviewQuality Spy Overview
Quality Spy Overview
 
A Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software TestingA Rapid Introduction to Rapid Software Testing
A Rapid Introduction to Rapid Software Testing
 
Learn Learning + Prototype Testing
Learn Learning + Prototype TestingLearn Learning + Prototype Testing
Learn Learning + Prototype Testing
 
Simon Peter Schrjver: Pair Testing
Simon Peter Schrjver: Pair TestingSimon Peter Schrjver: Pair Testing
Simon Peter Schrjver: Pair Testing
 
! Testing for agile teams
! Testing for agile teams! Testing for agile teams
! Testing for agile teams
 
Tester Challenges in Agile ?
Tester Challenges in Agile ?Tester Challenges in Agile ?
Tester Challenges in Agile ?
 
Agile process
Agile processAgile process
Agile process
 
A Software Testing Intro
A Software Testing IntroA Software Testing Intro
A Software Testing Intro
 
Exploratory testing
Exploratory testingExploratory testing
Exploratory testing
 
Fundamentals_of_Software_testing.pptx
Fundamentals_of_Software_testing.pptxFundamentals_of_Software_testing.pptx
Fundamentals_of_Software_testing.pptx
 
Agile testingandautomation
Agile testingandautomationAgile testingandautomation
Agile testingandautomation
 
Exploratory testing
Exploratory testingExploratory testing
Exploratory testing
 
01 software testing_introduction
01 software testing_introduction01 software testing_introduction
01 software testing_introduction
 

Recently uploaded

Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
informapgpstrackings
 
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
Globus
 
Lecture 1 Introduction to games development
Lecture 1 Introduction to games developmentLecture 1 Introduction to games development
Lecture 1 Introduction to games development
abdulrafaychaudhry
 
How to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good PracticesHow to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good Practices
Globus
 
Strategies for Successful Data Migration Tools.pptx
Strategies for Successful Data Migration Tools.pptxStrategies for Successful Data Migration Tools.pptx
Strategies for Successful Data Migration Tools.pptx
varshanayak241
 
Visitor Management System in India- Vizman.app
Visitor Management System in India- Vizman.appVisitor Management System in India- Vizman.app
Visitor Management System in India- Vizman.app
NaapbooksPrivateLimi
 
Software Testing Exam imp Ques Notes.pdf
Software Testing Exam imp Ques Notes.pdfSoftware Testing Exam imp Ques Notes.pdf
Software Testing Exam imp Ques Notes.pdf
MayankTawar1
 
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Globus
 
Quarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden ExtensionsQuarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden Extensions
Max Andersen
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
takuyayamamoto1800
 
First Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User EndpointsFirst Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User Endpoints
Globus
 
How Recreation Management Software Can Streamline Your Operations.pptx
How Recreation Management Software Can Streamline Your Operations.pptxHow Recreation Management Software Can Streamline Your Operations.pptx
How Recreation Management Software Can Streamline Your Operations.pptx
wottaspaceseo
 
Large Language Models and the End of Programming
Large Language Models and the End of ProgrammingLarge Language Models and the End of Programming
Large Language Models and the End of Programming
Matt Welsh
 
BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024
Ortus Solutions, Corp
 
Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus
 
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.ILBeyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Natan Silnitsky
 
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
Juraj Vysvader
 
De mooiste recreatieve routes ontdekken met RouteYou en FME
De mooiste recreatieve routes ontdekken met RouteYou en FMEDe mooiste recreatieve routes ontdekken met RouteYou en FME
De mooiste recreatieve routes ontdekken met RouteYou en FME
Jelle | Nordend
 
Enhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdfEnhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdf
Globus
 
Advanced Flow Concepts Every Developer Should Know
Advanced Flow Concepts Every Developer Should KnowAdvanced Flow Concepts Every Developer Should Know
Advanced Flow Concepts Every Developer Should Know
Peter Caitens
 

Recently uploaded (20)

Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
Field Employee Tracking System| MiTrack App| Best Employee Tracking Solution|...
 
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
Climate Science Flows: Enabling Petabyte-Scale Climate Analysis with the Eart...
 
Lecture 1 Introduction to games development
Lecture 1 Introduction to games developmentLecture 1 Introduction to games development
Lecture 1 Introduction to games development
 
How to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good PracticesHow to Position Your Globus Data Portal for Success Ten Good Practices
How to Position Your Globus Data Portal for Success Ten Good Practices
 
Strategies for Successful Data Migration Tools.pptx
Strategies for Successful Data Migration Tools.pptxStrategies for Successful Data Migration Tools.pptx
Strategies for Successful Data Migration Tools.pptx
 
Visitor Management System in India- Vizman.app
Visitor Management System in India- Vizman.appVisitor Management System in India- Vizman.app
Visitor Management System in India- Vizman.app
 
Software Testing Exam imp Ques Notes.pdf
Software Testing Exam imp Ques Notes.pdfSoftware Testing Exam imp Ques Notes.pdf
Software Testing Exam imp Ques Notes.pdf
 
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...
 
Quarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden ExtensionsQuarkus Hidden and Forbidden Extensions
Quarkus Hidden and Forbidden Extensions
 
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoamOpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
OpenFOAM solver for Helmholtz equation, helmholtzFoam / helmholtzBubbleFoam
 
First Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User EndpointsFirst Steps with Globus Compute Multi-User Endpoints
First Steps with Globus Compute Multi-User Endpoints
 
How Recreation Management Software Can Streamline Your Operations.pptx
How Recreation Management Software Can Streamline Your Operations.pptxHow Recreation Management Software Can Streamline Your Operations.pptx
How Recreation Management Software Can Streamline Your Operations.pptx
 
Large Language Models and the End of Programming
Large Language Models and the End of ProgrammingLarge Language Models and the End of Programming
Large Language Models and the End of Programming
 
BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024BoxLang: Review our Visionary Licenses of 2024
BoxLang: Review our Visionary Licenses of 2024
 
Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024Globus Compute wth IRI Workflows - GlobusWorld 2024
Globus Compute wth IRI Workflows - GlobusWorld 2024
 
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.ILBeyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL
 
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
In 2015, I used to write extensions for Joomla, WordPress, phpBB3, etc and I ...
 
De mooiste recreatieve routes ontdekken met RouteYou en FME
De mooiste recreatieve routes ontdekken met RouteYou en FMEDe mooiste recreatieve routes ontdekken met RouteYou en FME
De mooiste recreatieve routes ontdekken met RouteYou en FME
 
Enhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdfEnhancing Research Orchestration Capabilities at ORNL.pdf
Enhancing Research Orchestration Capabilities at ORNL.pdf
 
Advanced Flow Concepts Every Developer Should Know
Advanced Flow Concepts Every Developer Should KnowAdvanced Flow Concepts Every Developer Should Know
Advanced Flow Concepts Every Developer Should Know
 

Worst practices in software testing by the Testing troll

  • 1. Viktor Slavchev & The Testing troll Siteground The “worst” practices of software testing
  • 2. About me • Senior QA @ Siteground Hosting • Wooden philosopher at Pragmatic (part time) • Blogger @ mrslavchev.com(long time ago in a galaxy far far away) • True believer that testing is a human centric activity
  • 3. • A mythical testing creature • Graduated the technical university of Trolandia • Certified as SHGMCNGTT - Super Hyper Giga Mega Certified Ninja Guru Testing troll • Book author About The testing troll
  • 4. And the book: • Absolute bestseller • Sold more copies than “50 shades of gray” in Trolandia • “Absolutely mind-blowing” New York Times • “The troll is strong with this one” Darth Vader
  • 5. Best practice#1 - Rely on requirements and documentation
  • 6. Worst practice #1: Learn about the real testing oracles instead Testing oracles can benefit from:
  • 7. Feelings and mental models • It starts as a feeling • Not sufficient for a bug report
  • 9. Experience in: • The domain • General testing • Software industry
  • 10. Conference • Developers • Other testers • Clients • Anyone who matters
  • 11. Example 1: Reference oracle • External application • Other platform • Correctness presumed
  • 12. Example 2: Self-verifying data as an oracle Desired response: Credit card #: 000: Approved 4470330769941000 010: Partially Approved 4658512425423010 110: Insufficient Funds 4488282659650110
  • 13. Example 3: Constraints oracle Example: VAT number BG123456789 • Length • Country index • Spaces Source:The Oracle Problem and the Teaching of Software Testing
  • 14. Best practice#2 - Do regression testing by executing your old tests Regression testing != repetitive testing
  • 15. Repetitive testing is the reason why “others” see testing like this...
  • 16. Worst practice #2: Regression checks and focus on tests that reveal new information Regress - verb • to move backward; go back. • to revert to an earlier or less advanced state or form
  • 17. Regression bug: • Bug causing regress in quality Regression testing: • Testing to expose regression bugs
  • 18. Regression check: • Building part of a test • Definite answer • Small and easy to manage Focus on information
  • 19. Best practice#3 - Automationion testing is the best, “manual” testing sucks
  • 20. Quote from J. Kohl - Tap into mobile application testing Ideas that will produce bug-free software: • C++ STL • OOP • Agile • TDD • Test automation
  • 21. Quote from J. Kohl - Tap into mobile application testing “Each of these were also used to tell me that testers would no longer be needed on software projects. So far, I am fifteen years in and I haven’t seen anything bug free yet.”
  • 22. Can a testing tool produce better testers? Answer:
  • 23. How to make efficient automation that provides value to testing? The answer is:
  • 24. Worst practice #3: Use automation as a tool • To extend your abilities • Not to replace you completely • To ask the right questions
  • 25. Automation is great for: • Confirmation / Verification • Low level checking • Precision • Functional correctness • Solving machine problems
  • 26. But automation sucks when dealing with: • Exploration • Unanticipated risks • Qualitative evaluation • Open ended questions • Solving human problems Source:Things Could Get Worse- Michael Bolton
  • 27. Source: The non-manual, unautomated tester
  • 28. Best practice#4 - Assure quality Quality is not a resource Quality != testing
  • 29. Worst practice #4: Provide information about risks • Risk based testing - focus testing to explore potential risks
  • 30. “Nightmare newspaper headings” • You missed a critical bug in production • It caused your company a huge financial loss • What would it be?
  • 31. • Pre-mortem - imagining a failure and working backwards in order to determine the possible risks. Benefits: • Evaluation of risks • Business perspective • Prioritization
  • 32. Best practice#5 - Follow best practices
  • 33. Worst practice #5: Be always alert and aware of your context • What would be your approach in 3 different contexts?
  • 34. Context #1: Weather app • You’re an outsourced testing expert • Working for a start-up • Low on budget • Behind schedule
  • 35. Context #2: Medical software • High precision is a must • Human lives might depend on it • Regulatory compliance of testing
  • 36. Context #3: Court case • Bug caused an injury • You are independant expert • On a case for negligence in testing
  • 37. Questions: • How exhaustive will be your testing in each context? • Will bug-hunting be your highest priority? • Will you have the same strategy of testing?
  • 38. Conclusion • No best practices! • “We are not into the belief business” J.Bach • In order to be a good tester, you have to be a professional sceptic
  • 39. Thank you very much! … And don’t forget to Rock ‘n Troll
  • 40. Image credits: Too lazy to post them all. Image credits go to the almighty internet, I don’t own any of the images included in this presentation, except the ones created by me, linked to my blog.