1Software Testing – Present Problems and Future SolutionsVipul Kocher
2Science Fiction – Fiction today, Reality tomorrowArthur C. Clark Geosynchronous satellites (1945) – Actual satellites (1963)Cloning  - DollyJules Verne’s “Twenty Thousand leagues under the sea” (1869) – Simon Lake built “Argonaut” first submarine to operate in the open seas (1897)
3What About These?Androids   TimeTeleportationWhat about                 ?           travel?                        ? How about self testing code? May that never become a reality as long as I live…
4assumptions
5AssumptionsAll future solutions are based on today’s technologies
Disruptiveinnovationslike new class of operating systems, development paradigms, languages may significantly alter the landscapes6AssumptionsI have a few ideas on new class of Operating Systems
 new class of programming languages and paradigms to support that operating system
 ultimately supported by new class of hardwareI have no clue about it !
7problems in testing
8Problems in TestingAre there problemsin testing? 		We all seem to be doing fine!Probably the biggest problem in testing  is-“we do not have a problem”
9Problems in TestingWhy is this aproblem? Is there a solution in future?Only two things are infinite, the universe and human stupidity, and I'm not sure about the former. --  Albert Einstein
10challenges in testing
11Challenges in Testing What does testing mean for different stakeholders?
 Have we tested enough?
 How much time do I need to test it?
 How many test cases should I write?
 Oracle problem
 How do I choose right set of regression tests?
 How do I get developers to do better testing?
 Do I need coding skills? What will I do with those?
 How do I teaching testing to my testers?12What does testing mean for different stakeholders
13What does testing mean for different stakeholders?Let us face itNobody wants testing…
14What does testing mean for different stakeholders?If one assumes that “testing is necessary” one is likely to try to improve the way testing gets doneIf one believes that testing is unnecessary then one is more likely to find ways to minimize or eliminate testingMindset Matters !
15testing world’s biggest problem
16Testing World’s biggest problemWhere is the innovationin testing?
Innovation as in Breakthrough Innovation?17Testing World’s biggest problemCan you name three breakthrough innovations in testing? At least one?Where does the future of testing lie?
18HITEEHITHave I Tested Enough Do you have a bulletproof answer?
19HITEFirst define “ENOUGH” – Today - No catastrophic or critical or major failure for usersTomorrow - ?20HITEIntegrated software status monitor- Explained later (Patent Pending)
New software technology- Self monitoring (Patent Pending), Self healing systems
Software testing as a distributed, automated service - you pay software companies to install software on your system and test it (Patent Pending)21How much time do I need to test it
22How much time do I need to test itWhat are the problems you face in answering this question?What are the solutions today? Estimation techniques? Work Breakdown Structure? Function Points? Test Points? Use Case Points?
 Historical Data? Rule of thumb? Gut feel?Are these accurate? What aboutDifferent levels of quality, workmanship (developers and testers both), project constraints such as budget, time and Subsequent Regression Cycles?Future solution A mechanism to define quality level and a mechanism to measure that level (Patent Pending)
 Collection and analysis of data in automated manner and predictions based on current state of the project (Patent Pending)23Bug – The Only Perfect Being
24Bug – The Only Perfect BeingMost bugs are because imperfect requirements are imperfectly translated into imperfect design which is imperfectly translated into imperfect code
25Whole Is More Than The Sum Of Parts
26Whole Is More Than The Sum Of PartsAn integrated environment where…
27Whole Is More Than The Sum Of PartsAn integrated environment where…
28Integrated EnvironmentRequirementsVisual Prioritized Self-checking Testable ConstrainedDesign – Mapped to RequirementTests – Mapped to Requirements/Design/CodeCode – Mapped to Requirements/Design
29Regression Test Selection Tool

Bug debug keynote - Present problems and future solutions

  • 1.
    1Software Testing –Present Problems and Future SolutionsVipul Kocher
  • 2.
    2Science Fiction –Fiction today, Reality tomorrowArthur C. Clark Geosynchronous satellites (1945) – Actual satellites (1963)Cloning - DollyJules Verne’s “Twenty Thousand leagues under the sea” (1869) – Simon Lake built “Argonaut” first submarine to operate in the open seas (1897)
  • 3.
    3What About These?Androids TimeTeleportationWhat about ? travel? ? How about self testing code? May that never become a reality as long as I live…
  • 4.
  • 5.
    5AssumptionsAll future solutionsare based on today’s technologies
  • 6.
    Disruptiveinnovationslike new classof operating systems, development paradigms, languages may significantly alter the landscapes6AssumptionsI have a few ideas on new class of Operating Systems
  • 7.
    new classof programming languages and paradigms to support that operating system
  • 8.
    ultimately supportedby new class of hardwareI have no clue about it !
  • 9.
  • 10.
    8Problems in TestingArethere problemsin testing? We all seem to be doing fine!Probably the biggest problem in testing is-“we do not have a problem”
  • 11.
    9Problems in TestingWhyis this aproblem? Is there a solution in future?Only two things are infinite, the universe and human stupidity, and I'm not sure about the former. --  Albert Einstein
  • 12.
  • 13.
    11Challenges in TestingWhat does testing mean for different stakeholders?
  • 14.
    Have wetested enough?
  • 15.
    How muchtime do I need to test it?
  • 16.
    How manytest cases should I write?
  • 17.
  • 18.
    How doI choose right set of regression tests?
  • 19.
    How doI get developers to do better testing?
  • 20.
    Do Ineed coding skills? What will I do with those?
  • 21.
    How doI teaching testing to my testers?12What does testing mean for different stakeholders
  • 22.
    13What does testingmean for different stakeholders?Let us face itNobody wants testing…
  • 23.
    14What does testingmean for different stakeholders?If one assumes that “testing is necessary” one is likely to try to improve the way testing gets doneIf one believes that testing is unnecessary then one is more likely to find ways to minimize or eliminate testingMindset Matters !
  • 24.
  • 25.
    16Testing World’s biggestproblemWhere is the innovationin testing?
  • 26.
    Innovation as inBreakthrough Innovation?17Testing World’s biggest problemCan you name three breakthrough innovations in testing? At least one?Where does the future of testing lie?
  • 27.
    18HITEEHITHave I TestedEnough Do you have a bulletproof answer?
  • 28.
    19HITEFirst define “ENOUGH”– Today - No catastrophic or critical or major failure for usersTomorrow - ?20HITEIntegrated software status monitor- Explained later (Patent Pending)
  • 29.
    New software technology-Self monitoring (Patent Pending), Self healing systems
  • 30.
    Software testing asa distributed, automated service - you pay software companies to install software on your system and test it (Patent Pending)21How much time do I need to test it
  • 31.
    22How much timedo I need to test itWhat are the problems you face in answering this question?What are the solutions today? Estimation techniques? Work Breakdown Structure? Function Points? Test Points? Use Case Points?
  • 32.
    Historical Data?Rule of thumb? Gut feel?Are these accurate? What aboutDifferent levels of quality, workmanship (developers and testers both), project constraints such as budget, time and Subsequent Regression Cycles?Future solution A mechanism to define quality level and a mechanism to measure that level (Patent Pending)
  • 33.
    Collection andanalysis of data in automated manner and predictions based on current state of the project (Patent Pending)23Bug – The Only Perfect Being
  • 34.
    24Bug – TheOnly Perfect BeingMost bugs are because imperfect requirements are imperfectly translated into imperfect design which is imperfectly translated into imperfect code
  • 35.
    25Whole Is MoreThan The Sum Of Parts
  • 36.
    26Whole Is MoreThan The Sum Of PartsAn integrated environment where…
  • 37.
    27Whole Is MoreThan The Sum Of PartsAn integrated environment where…
  • 38.
    28Integrated EnvironmentRequirementsVisual PrioritizedSelf-checking Testable ConstrainedDesign – Mapped to RequirementTests – Mapped to Requirements/Design/CodeCode – Mapped to Requirements/Design
  • 39.