SlideShare a Scribd company logo
1 of 17
Download to read offline
Testing In The The Real
World
Testing types, reporting,
& why doing the
unexpected can be great.
The Pareto principle:
80 % of the important errors come from 20% of the code
All the tests should meet the customer requirements for risks.
Software testing should be performed by third party, to minimize
bias.
Exhaustive testing is not possible - we need the optimal amount of
testing, based on the risk assessment of the application.
All the test areas and coverages should be planned before
beginning.
Start testing with small parts and extend it to large parts.
You should strive for quality work, and be proud of it.
Smoke Testing
Testing for unstable software: not often sent to third parties
Verifies critical function
Does it start?
Does the interface function?
New systems
Before functional test
Before regression tests
Reject something badly broken
Sanity Testing (Tester Acceptance)
Does the fix seem to be rational?
Often unscripted and exploratory, to determine if the
fix/build is suitable for further testing.
Bundled with Smoke Testing in many cases, for time and
testing efficiency.
Unit Testing
Goal is to find errors, insure design, & all requirements are met
In a program, we are checking if the unit works as intended
Checks for misunderstood or incorrect arithmetic precedence
Avoids incorrect initialization
Needs to be independent
Focus is on the smallest units:
– functions
– loops
– classes
Unit Testing
The more code you have to
touch, the greater the
chances that you may miss
something - good automated
unit test cases help. Once
you make your changes, you
run all the unit tests for that
whole component where you
made the change.
A well-written unit test can
prove that changes did not
cause unexpected errors
Tests should:
Run quickly
Be repeatable
Test all the executable code
in that unit
Break logic into small
chunks
Regression Testing
Does old code work with new changes?
In addition to unit testing
Change in requirements
New fixture
Defect or performance fix
– Areas that have frequent defect or are visible to
users
– Boundary, Success and Failure tests
Integration Testing
Top- Down:
Some of the modules may not be available to test, or
they may represent an external system. The modules
are tested in relationship to each other, then touch the
'stubs'
Integration Testing
Bottom – up:
The lowest-level components are tested first to insure
they work, then the next 'layer' is added, using drivers
where needed. Can narrow down error locations.
Functional (End-to-End) Testing
This is what most think of
as “testing.”
All the individual parts
have been tested, and
they work together.
Does the system work as a
user would expect it to?
You test for requirements,
as well as business-based
scenarios.
Be careful when writing
your tests! Duplication is
easy, and logical errors
might be missed.
System Testing
Mostly Black-box “Does this give expected results?”
External interfaces
Multi-program/complex functions
Security and recovery
Installability and usability
Documentation
In other words:
Does this work for the user?
Load (Performance) Testing
Tests normal workload conditions
Does not break the system
Ensures that errors are trackable
May test rollover to a new client once a certain limit is
passed
Stress (Performance) Testing
Stress Testing: Extreme Conditions until failure
Application Stress: Finding locks and blocks, network
issues, and bottlenecks
Transactional Stress: Fine tuning the system between two
applications
Systemic Stress: What happens when one system blocks
another?
Exploratory Stress: One in a million scenarios – like the
database going offline when being accessed
Stress (Performance) Testing
Stress Testing: Extreme Conditions until failure
Manage and handle user problem and new requirements
Execute regression testing for any changes
• Code
• System
• Updates and patches of dependencies
Alpha Testing
Does the product work?
Focus is finding bugs and getting ready for Beta
Typically starts in the 60 -80% complete range
1 to 2 weeks per test cycle
Employee involvement for launch
Lots of bugs and crashes
Severe issues, and features may change
Beta Testing
Do customers like the product?
80 – 90% complete
3-6 week testing, normally no more than 2 cycles
Strangers testing the product
Mostly complete – small bugs, and missing things
Critical issues fixed – future plans made
Do your users find this useful, and are happy?
Field Testing
Done on real devices, away from the tester's lab or the
software development area.
This is a typical user in typical conditions that the
software is designed to assist with.
Field testing makes sure that the program works, under
typical user conditions:
Make sure you know what those are!

More Related Content

What's hot

All you need to know about regression testing | David Tzemach
All you need to know about regression testing | David TzemachAll you need to know about regression testing | David Tzemach
All you need to know about regression testing | David TzemachDavid Tzemach
 
User acceptance testing_(uat) 2013
User acceptance testing_(uat) 2013User acceptance testing_(uat) 2013
User acceptance testing_(uat) 2013Amrita Sinha
 
Seven testing principles
Seven testing principlesSeven testing principles
Seven testing principlesVaibhav Dash
 
What will testing look like in year 2020
What will testing look like in year 2020What will testing look like in year 2020
What will testing look like in year 2020BugRaptors
 
What is Sanity Testing? Edureka
What is Sanity Testing? EdurekaWhat is Sanity Testing? Edureka
What is Sanity Testing? EdurekaEdureka!
 
The complete guide for negative testing | David Tzemach
The complete guide for negative testing | David TzemachThe complete guide for negative testing | David Tzemach
The complete guide for negative testing | David TzemachDavid Tzemach
 
Software Testing Principles and  Techniques
Software Testing Principles and  Techniques Software Testing Principles and  Techniques
Software Testing Principles and  Techniques suresh ramanujam
 
Reporting On The Testing Process
Reporting On The Testing ProcessReporting On The Testing Process
Reporting On The Testing Processgavhays
 
Best practices for test automation
Best practices for test automationBest practices for test automation
Best practices for test automationDavid Tzemach
 
Automated visual-regression-testing (1)
Automated visual-regression-testing (1)Automated visual-regression-testing (1)
Automated visual-regression-testing (1)Sriram Angajala
 
Software Testing
Software TestingSoftware Testing
Software TestingSKumar11384
 
UAT Kickoff Presentation 10 29 09
UAT Kickoff Presentation 10 29 09UAT Kickoff Presentation 10 29 09
UAT Kickoff Presentation 10 29 09goozer65
 
The Myths and Facts Surrounding Software Testing
The Myths and Facts Surrounding Software TestingThe Myths and Facts Surrounding Software Testing
The Myths and Facts Surrounding Software TestingSoftware Testing Solution
 

What's hot (20)

All you need to know about regression testing | David Tzemach
All you need to know about regression testing | David TzemachAll you need to know about regression testing | David Tzemach
All you need to know about regression testing | David Tzemach
 
User acceptance testing_(uat) 2013
User acceptance testing_(uat) 2013User acceptance testing_(uat) 2013
User acceptance testing_(uat) 2013
 
Negative Testing
Negative TestingNegative Testing
Negative Testing
 
Sanity testing and smoke testing
Sanity testing and smoke testingSanity testing and smoke testing
Sanity testing and smoke testing
 
Seven testing principles
Seven testing principlesSeven testing principles
Seven testing principles
 
Principles of software testing
Principles of software testingPrinciples of software testing
Principles of software testing
 
What will testing look like in year 2020
What will testing look like in year 2020What will testing look like in year 2020
What will testing look like in year 2020
 
What is Sanity Testing? Edureka
What is Sanity Testing? EdurekaWhat is Sanity Testing? Edureka
What is Sanity Testing? Edureka
 
The complete guide for negative testing | David Tzemach
The complete guide for negative testing | David TzemachThe complete guide for negative testing | David Tzemach
The complete guide for negative testing | David Tzemach
 
Software Testing Principles and  Techniques
Software Testing Principles and  Techniques Software Testing Principles and  Techniques
Software Testing Principles and  Techniques
 
Smoke testing
Smoke testingSmoke testing
Smoke testing
 
Functional testing
Functional testingFunctional testing
Functional testing
 
Getting Ready for UAT
Getting Ready for UATGetting Ready for UAT
Getting Ready for UAT
 
Reporting On The Testing Process
Reporting On The Testing ProcessReporting On The Testing Process
Reporting On The Testing Process
 
7 testing principles
7 testing principles7 testing principles
7 testing principles
 
Best practices for test automation
Best practices for test automationBest practices for test automation
Best practices for test automation
 
Automated visual-regression-testing (1)
Automated visual-regression-testing (1)Automated visual-regression-testing (1)
Automated visual-regression-testing (1)
 
Software Testing
Software TestingSoftware Testing
Software Testing
 
UAT Kickoff Presentation 10 29 09
UAT Kickoff Presentation 10 29 09UAT Kickoff Presentation 10 29 09
UAT Kickoff Presentation 10 29 09
 
The Myths and Facts Surrounding Software Testing
The Myths and Facts Surrounding Software TestingThe Myths and Facts Surrounding Software Testing
The Myths and Facts Surrounding Software Testing
 

Similar to Testing 3: Types Of Tests That May Be Required (20)

Testing
TestingTesting
Testing
 
Software Testing
Software TestingSoftware Testing
Software Testing
 
Testing
TestingTesting
Testing
 
Software test life cycle
Software test life cycleSoftware test life cycle
Software test life cycle
 
Testing methodology
Testing methodologyTesting methodology
Testing methodology
 
Software test proposal
Software test proposalSoftware test proposal
Software test proposal
 
Software testing2
Software testing2Software testing2
Software testing2
 
Software testing
Software testingSoftware testing
Software testing
 
Software testing
Software testingSoftware testing
Software testing
 
Software testing
Software testingSoftware testing
Software testing
 
Demo1ghjkl
Demo1ghjklDemo1ghjkl
Demo1ghjkl
 
Software testing
Software testingSoftware testing
Software testing
 
Testing type
Testing typeTesting type
Testing type
 
Types
TypesTypes
Types
 
Testing strategies
Testing strategiesTesting strategies
Testing strategies
 
unit 4.pptx very needful and important p
unit 4.pptx very needful and important punit 4.pptx very needful and important p
unit 4.pptx very needful and important p
 
Software testing
Software testingSoftware testing
Software testing
 
Testing
Testing Testing
Testing
 
Software testing
Software testingSoftware testing
Software testing
 
Software testing
Software testingSoftware testing
Software testing
 

Recently uploaded

online pdf editor software solutions.pdf
online pdf editor software solutions.pdfonline pdf editor software solutions.pdf
online pdf editor software solutions.pdfMeon Technology
 
Enterprise Document Management System - Qualityze Inc
Enterprise Document Management System - Qualityze IncEnterprise Document Management System - Qualityze Inc
Enterprise Document Management System - Qualityze Incrobinwilliams8624
 
Top Software Development Trends in 2024
Top Software Development Trends in  2024Top Software Development Trends in  2024
Top Software Development Trends in 2024Mind IT Systems
 
Webinar_050417_LeClair12345666777889.ppt
Webinar_050417_LeClair12345666777889.pptWebinar_050417_LeClair12345666777889.ppt
Webinar_050417_LeClair12345666777889.pptkinjal48
 
How Does the Epitome of Spyware Differ from Other Malicious Software?
How Does the Epitome of Spyware Differ from Other Malicious Software?How Does the Epitome of Spyware Differ from Other Malicious Software?
How Does the Epitome of Spyware Differ from Other Malicious Software?AmeliaSmith90
 
Sales Territory Management: A Definitive Guide to Expand Sales Coverage
Sales Territory Management: A Definitive Guide to Expand Sales CoverageSales Territory Management: A Definitive Guide to Expand Sales Coverage
Sales Territory Management: A Definitive Guide to Expand Sales CoverageDista
 
Cybersecurity Challenges with Generative AI - for Good and Bad
Cybersecurity Challenges with Generative AI - for Good and BadCybersecurity Challenges with Generative AI - for Good and Bad
Cybersecurity Challenges with Generative AI - for Good and BadIvo Andreev
 
Kawika Technologies pvt ltd Software Development Company in Trivandrum
Kawika Technologies pvt ltd Software Development Company in TrivandrumKawika Technologies pvt ltd Software Development Company in Trivandrum
Kawika Technologies pvt ltd Software Development Company in TrivandrumKawika Technologies
 
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine HarmonyLeveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmonyelliciumsolutionspun
 
Generative AI for Cybersecurity - EC-Council
Generative AI for Cybersecurity - EC-CouncilGenerative AI for Cybersecurity - EC-Council
Generative AI for Cybersecurity - EC-CouncilVICTOR MAESTRE RAMIREZ
 
OpenChain Webinar: Universal CVSS Calculator
OpenChain Webinar: Universal CVSS CalculatorOpenChain Webinar: Universal CVSS Calculator
OpenChain Webinar: Universal CVSS CalculatorShane Coughlan
 
Introduction-to-Software-Development-Outsourcing.pptx
Introduction-to-Software-Development-Outsourcing.pptxIntroduction-to-Software-Development-Outsourcing.pptx
Introduction-to-Software-Development-Outsourcing.pptxIntelliSource Technologies
 
Fields in Java and Kotlin and what to expect.pptx
Fields in Java and Kotlin and what to expect.pptxFields in Java and Kotlin and what to expect.pptx
Fields in Java and Kotlin and what to expect.pptxJoão Esperancinha
 
AI Embracing Every Shade of Human Beauty
AI Embracing Every Shade of Human BeautyAI Embracing Every Shade of Human Beauty
AI Embracing Every Shade of Human BeautyRaymond Okyere-Forson
 
Streamlining Your Application Builds with Cloud Native Buildpacks
Streamlining Your Application Builds  with Cloud Native BuildpacksStreamlining Your Application Builds  with Cloud Native Buildpacks
Streamlining Your Application Builds with Cloud Native BuildpacksVish Abrams
 
Big Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/ML
Big Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/MLBig Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/ML
Big Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/MLAlluxio, Inc.
 
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...OnePlan Solutions
 
ERP For Electrical and Electronics manufecturing.pptx
ERP For Electrical and Electronics manufecturing.pptxERP For Electrical and Electronics manufecturing.pptx
ERP For Electrical and Electronics manufecturing.pptxAutus Cyber Tech
 
Growing Oxen: channel operators and retries
Growing Oxen: channel operators and retriesGrowing Oxen: channel operators and retries
Growing Oxen: channel operators and retriesSoftwareMill
 

Recently uploaded (20)

online pdf editor software solutions.pdf
online pdf editor software solutions.pdfonline pdf editor software solutions.pdf
online pdf editor software solutions.pdf
 
Enterprise Document Management System - Qualityze Inc
Enterprise Document Management System - Qualityze IncEnterprise Document Management System - Qualityze Inc
Enterprise Document Management System - Qualityze Inc
 
Top Software Development Trends in 2024
Top Software Development Trends in  2024Top Software Development Trends in  2024
Top Software Development Trends in 2024
 
Webinar_050417_LeClair12345666777889.ppt
Webinar_050417_LeClair12345666777889.pptWebinar_050417_LeClair12345666777889.ppt
Webinar_050417_LeClair12345666777889.ppt
 
How Does the Epitome of Spyware Differ from Other Malicious Software?
How Does the Epitome of Spyware Differ from Other Malicious Software?How Does the Epitome of Spyware Differ from Other Malicious Software?
How Does the Epitome of Spyware Differ from Other Malicious Software?
 
Sales Territory Management: A Definitive Guide to Expand Sales Coverage
Sales Territory Management: A Definitive Guide to Expand Sales CoverageSales Territory Management: A Definitive Guide to Expand Sales Coverage
Sales Territory Management: A Definitive Guide to Expand Sales Coverage
 
Cybersecurity Challenges with Generative AI - for Good and Bad
Cybersecurity Challenges with Generative AI - for Good and BadCybersecurity Challenges with Generative AI - for Good and Bad
Cybersecurity Challenges with Generative AI - for Good and Bad
 
Kawika Technologies pvt ltd Software Development Company in Trivandrum
Kawika Technologies pvt ltd Software Development Company in TrivandrumKawika Technologies pvt ltd Software Development Company in Trivandrum
Kawika Technologies pvt ltd Software Development Company in Trivandrum
 
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine HarmonyLeveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
Leveraging DxSherpa's Generative AI Services to Unlock Human-Machine Harmony
 
Generative AI for Cybersecurity - EC-Council
Generative AI for Cybersecurity - EC-CouncilGenerative AI for Cybersecurity - EC-Council
Generative AI for Cybersecurity - EC-Council
 
OpenChain Webinar: Universal CVSS Calculator
OpenChain Webinar: Universal CVSS CalculatorOpenChain Webinar: Universal CVSS Calculator
OpenChain Webinar: Universal CVSS Calculator
 
Introduction-to-Software-Development-Outsourcing.pptx
Introduction-to-Software-Development-Outsourcing.pptxIntroduction-to-Software-Development-Outsourcing.pptx
Introduction-to-Software-Development-Outsourcing.pptx
 
Fields in Java and Kotlin and what to expect.pptx
Fields in Java and Kotlin and what to expect.pptxFields in Java and Kotlin and what to expect.pptx
Fields in Java and Kotlin and what to expect.pptx
 
AI Embracing Every Shade of Human Beauty
AI Embracing Every Shade of Human BeautyAI Embracing Every Shade of Human Beauty
AI Embracing Every Shade of Human Beauty
 
Salesforce AI Associate Certification.pptx
Salesforce AI Associate Certification.pptxSalesforce AI Associate Certification.pptx
Salesforce AI Associate Certification.pptx
 
Streamlining Your Application Builds with Cloud Native Buildpacks
Streamlining Your Application Builds  with Cloud Native BuildpacksStreamlining Your Application Builds  with Cloud Native Buildpacks
Streamlining Your Application Builds with Cloud Native Buildpacks
 
Big Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/ML
Big Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/MLBig Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/ML
Big Data Bellevue Meetup | Enhancing Python Data Loading in the Cloud for AI/ML
 
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
Transforming PMO Success with AI - Discover OnePlan Strategic Portfolio Work ...
 
ERP For Electrical and Electronics manufecturing.pptx
ERP For Electrical and Electronics manufecturing.pptxERP For Electrical and Electronics manufecturing.pptx
ERP For Electrical and Electronics manufecturing.pptx
 
Growing Oxen: channel operators and retries
Growing Oxen: channel operators and retriesGrowing Oxen: channel operators and retries
Growing Oxen: channel operators and retries
 

Testing 3: Types Of Tests That May Be Required

  • 1. Testing In The The Real World Testing types, reporting, & why doing the unexpected can be great.
  • 2. The Pareto principle: 80 % of the important errors come from 20% of the code All the tests should meet the customer requirements for risks. Software testing should be performed by third party, to minimize bias. Exhaustive testing is not possible - we need the optimal amount of testing, based on the risk assessment of the application. All the test areas and coverages should be planned before beginning. Start testing with small parts and extend it to large parts. You should strive for quality work, and be proud of it.
  • 3. Smoke Testing Testing for unstable software: not often sent to third parties Verifies critical function Does it start? Does the interface function? New systems Before functional test Before regression tests Reject something badly broken
  • 4. Sanity Testing (Tester Acceptance) Does the fix seem to be rational? Often unscripted and exploratory, to determine if the fix/build is suitable for further testing. Bundled with Smoke Testing in many cases, for time and testing efficiency.
  • 5. Unit Testing Goal is to find errors, insure design, & all requirements are met In a program, we are checking if the unit works as intended Checks for misunderstood or incorrect arithmetic precedence Avoids incorrect initialization Needs to be independent Focus is on the smallest units: – functions – loops – classes
  • 6. Unit Testing The more code you have to touch, the greater the chances that you may miss something - good automated unit test cases help. Once you make your changes, you run all the unit tests for that whole component where you made the change. A well-written unit test can prove that changes did not cause unexpected errors Tests should: Run quickly Be repeatable Test all the executable code in that unit Break logic into small chunks
  • 7. Regression Testing Does old code work with new changes? In addition to unit testing Change in requirements New fixture Defect or performance fix – Areas that have frequent defect or are visible to users – Boundary, Success and Failure tests
  • 8. Integration Testing Top- Down: Some of the modules may not be available to test, or they may represent an external system. The modules are tested in relationship to each other, then touch the 'stubs'
  • 9. Integration Testing Bottom – up: The lowest-level components are tested first to insure they work, then the next 'layer' is added, using drivers where needed. Can narrow down error locations.
  • 10. Functional (End-to-End) Testing This is what most think of as “testing.” All the individual parts have been tested, and they work together. Does the system work as a user would expect it to? You test for requirements, as well as business-based scenarios. Be careful when writing your tests! Duplication is easy, and logical errors might be missed.
  • 11. System Testing Mostly Black-box “Does this give expected results?” External interfaces Multi-program/complex functions Security and recovery Installability and usability Documentation In other words: Does this work for the user?
  • 12. Load (Performance) Testing Tests normal workload conditions Does not break the system Ensures that errors are trackable May test rollover to a new client once a certain limit is passed
  • 13. Stress (Performance) Testing Stress Testing: Extreme Conditions until failure Application Stress: Finding locks and blocks, network issues, and bottlenecks Transactional Stress: Fine tuning the system between two applications Systemic Stress: What happens when one system blocks another? Exploratory Stress: One in a million scenarios – like the database going offline when being accessed
  • 14. Stress (Performance) Testing Stress Testing: Extreme Conditions until failure Manage and handle user problem and new requirements Execute regression testing for any changes • Code • System • Updates and patches of dependencies
  • 15. Alpha Testing Does the product work? Focus is finding bugs and getting ready for Beta Typically starts in the 60 -80% complete range 1 to 2 weeks per test cycle Employee involvement for launch Lots of bugs and crashes Severe issues, and features may change
  • 16. Beta Testing Do customers like the product? 80 – 90% complete 3-6 week testing, normally no more than 2 cycles Strangers testing the product Mostly complete – small bugs, and missing things Critical issues fixed – future plans made Do your users find this useful, and are happy?
  • 17. Field Testing Done on real devices, away from the tester's lab or the software development area. This is a typical user in typical conditions that the software is designed to assist with. Field testing makes sure that the program works, under typical user conditions: Make sure you know what those are!