SlideShare a Scribd company logo
1 of 13
FUNDAMENTAL TEST PROCESS
by Graham et.al (2011)
Yoga Pratama Putra
Department of Information System
Faculty of Science and Technology
State Islamic University of Sultan Syarif Kasim Riau
INTRODUCTION
In this section, we will describe the fundamental test process and
activities. These start with test planning and continue through to test
closure. For each part of the test process, we'll discuss the main tasks
of each test activity.
You'll also encounter the glossary terms confirmation testing, exit
criteria, incident, regression testing, test basis, test condition, test
coverage, test data, test execution, test log, test plan, test strategy,
test summary report and testware.
NEXT..
We can divide the activities within the fundamental test process into the
following basic steps:
 Test planning and control;
 Test analysis and design;
 Test implementation and execution;
 Test evaluating exit criteria and reporting;
 Test closure activities.
TEST
PLANNIG
&
CONTROL
During test planning, we make sure we understand the
goals and objectives of the customers, stakeholders, and
the project, and the risks which testing is intended to
address. This will give us what is sometimes called the
mission of testing or the test assignment. Based on this
understanding, we set the goals and objectives for the
testing itself, and derive an approach and plan for the
tests, including specification of test activities. To help us
we may have organization or program test policies and a
test strategy.
NEXT..
Test planning has the follow major tasks, given approxi- mately in
order, which help us build a test plan :
1. Determine the scope and risks and identify the objectives of testing
2. Determine the test approach (techniques, test items, coverage, identifying and
interfacing with the teams involved in testing, testware)
3. Implement the test policy and/or the test strategy
4. Determine the required test resources (e.g. people, test environment, PCs)
5. Schedule test analysis and design tasks, test implementation, execution and
evaluation
6. Determine the exit criteria
NEXT..
Test control has the following major tasks :
1. Measure and analyze the results of reviews and testing.
2. Monitor and document progress, test coverage and exit criteria.
3. Provide information actions.
4. Make decisions.
TEST
ANALYSIS
&
DESIGN
Test analysis and design has the following major tasks,
in approximately the following order:
 Review the test basis (such as the product risk
analysis, requirements, architecture, design
specifications, and interfaces), examining the
specifications for the software we are testing.
 Identify test conditions based on analysis of test items,
their specifications, and what we know about their
behavior and structure.
 Design the test.
 Evaluate testability of the requirements and system.
TEST
IMPLEMENTATIO
N
&
EXECUTION
During test implementation and execution, we take the
test conditions and make them into test cases and
testware and set up the test environment. This means
that, having put together a high-level design for our tests,
we now start to build them. We transform our test
conditions into test cases and procedures, other testware
such as scripts for automation. We also need to set up an
envi-ronment where we will run the tests and build our test
data. Setting up environ- ments and data often involves
significant time and effort, so you should plan and monitor
this work carefully.
NEXT..
Test implementation and execution have
the following major tasks, in
approximately the following order :
1. implementation :
 Develop and prioritize our test
cases.
 Create test suites from the test
cases for efficient test execution.
 Implement and verify the
environment.
2. Execution :
 Execute the test suites and
individual test cases, following our
test proce dures.
 Log the outcome of test execution
and record the identities and
versions of the software under
test, test tools and testware.
 Compare actual results (what
happened when we ran the tests)
with expected results (what we
anticipated would happen).
 Where there are differences
between actual and expected
results, report discrepancies as
incidents.
 Repeat test activities as a result
of action taken for each
discrepancy.
TEST
EVALUATING
EXIT CRITERIA
&
REPORTING
Evaluating exit criteria is the activity where test
execution is assessed against the defined objectives. This
should be done for each test level, as for each we need to
know whether we have done enough testing. Based on
our risk assess- ment, we'll have set criteria against which
we'll measure 'enough'. These criteria vary for each
project and are known as exit criteria.
NEXT..
Evaluating exit criteria has the following major tasks:
 Check test logs against the exit criteria specified in test planning: We look to see what
evidence we have for which tests have been executed and checked, and what defects
have been raised, fixed, confirmation tested, or are out standing.
 Assess if more tests are needed or if the exit criteria specified should be changed: We
may need to run more tests if we have not run all the tests we designed, or if we
realize we have not reached the coverage we expected, or if the risks have increased
for the project. We may need to change the exit criteria to lower them, if the business
and project risks rise in impor tance and the product or technical risks drop in
importance. Note that this is not easy to do and must be agreed with stakeholders. The
test manage ment tools and test coverage tools that we'll discuss in Chapter 6 help us
with this assessment.
 Write a test summary report for stakeholders: It is not enough that the testers know the
outcome of the test. All the stakeholders need to know what testing has been done and
the outcome of the testing, in order to make informed decisions about the software.
TEST
CLOSURE
ACTIVITIES
Test closure activities include the following major tasks:
 Check which planned deliverables we actually
delivered and ensure all incident reports have been
resolved through defect repair or deferral.
 Finalize and archive testware, such as scripts, the
test environment, and any other test infrastructure,
for later reuse.
 Hand over testware to the maintenance organization
who will support the software and make any bug fixes
or maintenance changes, for use in con firmation
testing and regression testing.
 Evaluate how the testing went and analyze lessons
learned for future releases and projects.
https://uin-suska.ac.id
https://sif.uin-suska.ac.id
https://www.linkedin.com/in/yoga-pratama-putra-395ba1134/

More Related Content

What's hot

Fundamentaltestprocess windirohmaheny11453205427 kelase
Fundamentaltestprocess windirohmaheny11453205427 kelaseFundamentaltestprocess windirohmaheny11453205427 kelase
Fundamentaltestprocess windirohmaheny11453205427 kelasewindi rohmaheny
 
Fundamental Test Process
Fundamental Test ProcessFundamental Test Process
Fundamental Test ProcessRakhesLeoPutra
 
Fundamental test process
Fundamental test processFundamental test process
Fundamental test processYoga Setiawan
 
Fundamental test process
Fundamental test process Fundamental test process
Fundamental test process alex swandi
 
Fundamental test process (andika m)
Fundamental test process (andika m)Fundamental test process (andika m)
Fundamental test process (andika m)Andika Mardanu
 
Test process
Test processTest process
Test processSoori Joy
 
Fundamental test process 1
Fundamental test process 1Fundamental test process 1
Fundamental test process 1Bima Alvamiko
 
Fundamental test process
Fundamental test processFundamental test process
Fundamental test processDinul
 
2 . fundamental test process
2 . fundamental test process2 . fundamental test process
2 . fundamental test processsabrian SIF
 
Fundamentals of testing
Fundamentals of testingFundamentals of testing
Fundamentals of testingM HiDayat
 
Test Execution
Test ExecutionTest Execution
Test ExecutionRajathi-QA
 
Overview of test process improvement frameworks
Overview of test process improvement frameworksOverview of test process improvement frameworks
Overview of test process improvement frameworksNikita Knysh
 
ITTM: Troubleshooting Skill Manual
ITTM: Troubleshooting Skill ManualITTM: Troubleshooting Skill Manual
ITTM: Troubleshooting Skill ManualNoel Temena
 
Testing 1 - the Basics
Testing 1 - the BasicsTesting 1 - the Basics
Testing 1 - the BasicsArleneAndrews2
 

What's hot (20)

Fundamentaltestprocess windirohmaheny11453205427 kelase
Fundamentaltestprocess windirohmaheny11453205427 kelaseFundamentaltestprocess windirohmaheny11453205427 kelase
Fundamentaltestprocess windirohmaheny11453205427 kelase
 
Fundamental Test Process
Fundamental Test ProcessFundamental Test Process
Fundamental Test Process
 
Fundamental test process
Fundamental test processFundamental test process
Fundamental test process
 
Fundamental test process
Fundamental test process Fundamental test process
Fundamental test process
 
Test Planning
Test PlanningTest Planning
Test Planning
 
Fundamental test process (andika m)
Fundamental test process (andika m)Fundamental test process (andika m)
Fundamental test process (andika m)
 
Test process
Test processTest process
Test process
 
Fundamental test process 1
Fundamental test process 1Fundamental test process 1
Fundamental test process 1
 
Fundamental test process
Fundamental test processFundamental test process
Fundamental test process
 
2 . fundamental test process
2 . fundamental test process2 . fundamental test process
2 . fundamental test process
 
Fundamental test process
Fundamental test processFundamental test process
Fundamental test process
 
Fundamentals of testing
Fundamentals of testingFundamentals of testing
Fundamentals of testing
 
Fundamental test process
Fundamental test processFundamental test process
Fundamental test process
 
Test management
Test managementTest management
Test management
 
Test Execution
Test ExecutionTest Execution
Test Execution
 
Overview of test process improvement frameworks
Overview of test process improvement frameworksOverview of test process improvement frameworks
Overview of test process improvement frameworks
 
ISTQB Test Process
ISTQB Test ProcessISTQB Test Process
ISTQB Test Process
 
ITTM: Troubleshooting Skill Manual
ITTM: Troubleshooting Skill ManualITTM: Troubleshooting Skill Manual
ITTM: Troubleshooting Skill Manual
 
Report test plan
Report test planReport test plan
Report test plan
 
Testing 1 - the Basics
Testing 1 - the BasicsTesting 1 - the Basics
Testing 1 - the Basics
 

Similar to Fundamental test process

Fundamental test process (TESTING IMPLEMENTATION SYSTEM)
Fundamental test process (TESTING IMPLEMENTATION SYSTEM)Fundamental test process (TESTING IMPLEMENTATION SYSTEM)
Fundamental test process (TESTING IMPLEMENTATION SYSTEM)Putri nadya Fazri
 
Fundamental test process
Fundamental test processFundamental test process
Fundamental test processIrvan Febry
 
FUNDAMENTAL TEST PROCESS
FUNDAMENTAL TEST PROCESSFUNDAMENTAL TEST PROCESS
FUNDAMENTAL TEST PROCESSMeychiaGaiza
 
Fundamental test process
Fundamental test processFundamental test process
Fundamental test processmuhammad afif
 
Bab i fundamental of testing
Bab i fundamental of testingBab i fundamental of testing
Bab i fundamental of testingRiauly Putra
 
Bab i fundamental of testing
Bab i fundamental of testingBab i fundamental of testing
Bab i fundamental of testingSyakir Arsalan
 
How to Write a Test Plan .pdf
How to Write a Test Plan .pdfHow to Write a Test Plan .pdf
How to Write a Test Plan .pdfSudhanshiBakre1
 
38475471 qa-and-software-testing-interview-questions-and-answers
38475471 qa-and-software-testing-interview-questions-and-answers38475471 qa-and-software-testing-interview-questions-and-answers
38475471 qa-and-software-testing-interview-questions-and-answersMaria FutureThoughts
 
Software-Testing-Chapgdgdgsghshshshshshshs
Software-Testing-ChapgdgdgsghshshshshshshsSoftware-Testing-Chapgdgdgsghshshshshshshs
Software-Testing-Chapgdgdgsghshshshshshshsshaikbab
 
Chapter 1 Fundamental of Testing
Chapter 1 Fundamental of TestingChapter 1 Fundamental of Testing
Chapter 1 Fundamental of TestingSiti Deny Nadiroha
 
Bab i fundamental of testing (yoga)
Bab i fundamental of testing (yoga)Bab i fundamental of testing (yoga)
Bab i fundamental of testing (yoga)sidjdhdjsks
 

Similar to Fundamental test process (19)

Fundamental test process (TESTING IMPLEMENTATION SYSTEM)
Fundamental test process (TESTING IMPLEMENTATION SYSTEM)Fundamental test process (TESTING IMPLEMENTATION SYSTEM)
Fundamental test process (TESTING IMPLEMENTATION SYSTEM)
 
Fundamental test process
Fundamental test processFundamental test process
Fundamental test process
 
FUNDAMENTAL TEST PROCESS
FUNDAMENTAL TEST PROCESSFUNDAMENTAL TEST PROCESS
FUNDAMENTAL TEST PROCESS
 
Fundamental test process
Fundamental test processFundamental test process
Fundamental test process
 
Fundamental test process
Fundamental test processFundamental test process
Fundamental test process
 
CTFL chapter 05
CTFL chapter 05CTFL chapter 05
CTFL chapter 05
 
Software Testing 2/5
Software Testing 2/5Software Testing 2/5
Software Testing 2/5
 
Bab i fundamental of testing
Bab i fundamental of testingBab i fundamental of testing
Bab i fundamental of testing
 
SDET UNIT 3.pptx
SDET UNIT 3.pptxSDET UNIT 3.pptx
SDET UNIT 3.pptx
 
STLC-ppt-1.pptx
STLC-ppt-1.pptxSTLC-ppt-1.pptx
STLC-ppt-1.pptx
 
Bab i fundamental of testing
Bab i fundamental of testingBab i fundamental of testing
Bab i fundamental of testing
 
How to Write a Test Plan .pdf
How to Write a Test Plan .pdfHow to Write a Test Plan .pdf
How to Write a Test Plan .pdf
 
Test Management
Test ManagementTest Management
Test Management
 
38475471 qa-and-software-testing-interview-questions-and-answers
38475471 qa-and-software-testing-interview-questions-and-answers38475471 qa-and-software-testing-interview-questions-and-answers
38475471 qa-and-software-testing-interview-questions-and-answers
 
Software-Testing-Chapgdgdgsghshshshshshshs
Software-Testing-ChapgdgdgsghshshshshshshsSoftware-Testing-Chapgdgdgsghshshshshshshs
Software-Testing-Chapgdgdgsghshshshshshshs
 
Chapter 1 Fundamental of Testing
Chapter 1 Fundamental of TestingChapter 1 Fundamental of Testing
Chapter 1 Fundamental of Testing
 
stlc
stlcstlc
stlc
 
Bab i fundamental of testing (yoga)
Bab i fundamental of testing (yoga)Bab i fundamental of testing (yoga)
Bab i fundamental of testing (yoga)
 
Fundamentals of testing
Fundamentals of testingFundamentals of testing
Fundamentals of testing
 

Recently uploaded

Call Girls Narol 7397865700 Independent Call Girls
Call Girls Narol 7397865700 Independent Call GirlsCall Girls Narol 7397865700 Independent Call Girls
Call Girls Narol 7397865700 Independent Call Girlsssuser7cb4ff
 
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escortsranjana rawat
 
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptxDecoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptxJoão Esperancinha
 
Call Girls Delhi {Jodhpur} 9711199012 high profile service
Call Girls Delhi {Jodhpur} 9711199012 high profile serviceCall Girls Delhi {Jodhpur} 9711199012 high profile service
Call Girls Delhi {Jodhpur} 9711199012 high profile servicerehmti665
 
Gurgaon ✡️9711147426✨Call In girls Gurgaon Sector 51 escort service
Gurgaon ✡️9711147426✨Call In girls Gurgaon Sector 51 escort serviceGurgaon ✡️9711147426✨Call In girls Gurgaon Sector 51 escort service
Gurgaon ✡️9711147426✨Call In girls Gurgaon Sector 51 escort servicejennyeacort
 
Biology for Computer Engineers Course Handout.pptx
Biology for Computer Engineers Course Handout.pptxBiology for Computer Engineers Course Handout.pptx
Biology for Computer Engineers Course Handout.pptxDeepakSakkari2
 
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur High Profile
 
What are the advantages and disadvantages of membrane structures.pptx
What are the advantages and disadvantages of membrane structures.pptxWhat are the advantages and disadvantages of membrane structures.pptx
What are the advantages and disadvantages of membrane structures.pptxwendy cai
 
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...Soham Mondal
 
GDSC ASEB Gen AI study jams presentation
GDSC ASEB Gen AI study jams presentationGDSC ASEB Gen AI study jams presentation
GDSC ASEB Gen AI study jams presentationGDSCAESB
 
Application of Residue Theorem to evaluate real integrations.pptx
Application of Residue Theorem to evaluate real integrations.pptxApplication of Residue Theorem to evaluate real integrations.pptx
Application of Residue Theorem to evaluate real integrations.pptx959SahilShah
 
Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝
Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝
Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝soniya singh
 
HARMONY IN THE HUMAN BEING - Unit-II UHV-2
HARMONY IN THE HUMAN BEING - Unit-II UHV-2HARMONY IN THE HUMAN BEING - Unit-II UHV-2
HARMONY IN THE HUMAN BEING - Unit-II UHV-2RajaP95
 
power system scada applications and uses
power system scada applications and usespower system scada applications and uses
power system scada applications and usesDevarapalliHaritha
 
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130Suhani Kapoor
 
IVE Industry Focused Event - Defence Sector 2024
IVE Industry Focused Event - Defence Sector 2024IVE Industry Focused Event - Defence Sector 2024
IVE Industry Focused Event - Defence Sector 2024Mark Billinghurst
 
Architect Hassan Khalil Portfolio for 2024
Architect Hassan Khalil Portfolio for 2024Architect Hassan Khalil Portfolio for 2024
Architect Hassan Khalil Portfolio for 2024hassan khalil
 
microprocessor 8085 and its interfacing
microprocessor 8085  and its interfacingmicroprocessor 8085  and its interfacing
microprocessor 8085 and its interfacingjaychoudhary37
 

Recently uploaded (20)

Call Girls Narol 7397865700 Independent Call Girls
Call Girls Narol 7397865700 Independent Call GirlsCall Girls Narol 7397865700 Independent Call Girls
Call Girls Narol 7397865700 Independent Call Girls
 
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
 
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptxDecoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
 
Call Girls Delhi {Jodhpur} 9711199012 high profile service
Call Girls Delhi {Jodhpur} 9711199012 high profile serviceCall Girls Delhi {Jodhpur} 9711199012 high profile service
Call Girls Delhi {Jodhpur} 9711199012 high profile service
 
Gurgaon ✡️9711147426✨Call In girls Gurgaon Sector 51 escort service
Gurgaon ✡️9711147426✨Call In girls Gurgaon Sector 51 escort serviceGurgaon ✡️9711147426✨Call In girls Gurgaon Sector 51 escort service
Gurgaon ✡️9711147426✨Call In girls Gurgaon Sector 51 escort service
 
Biology for Computer Engineers Course Handout.pptx
Biology for Computer Engineers Course Handout.pptxBiology for Computer Engineers Course Handout.pptx
Biology for Computer Engineers Course Handout.pptx
 
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
 
What are the advantages and disadvantages of membrane structures.pptx
What are the advantages and disadvantages of membrane structures.pptxWhat are the advantages and disadvantages of membrane structures.pptx
What are the advantages and disadvantages of membrane structures.pptx
 
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
 
Exploring_Network_Security_with_JA3_by_Rakesh Seal.pptx
Exploring_Network_Security_with_JA3_by_Rakesh Seal.pptxExploring_Network_Security_with_JA3_by_Rakesh Seal.pptx
Exploring_Network_Security_with_JA3_by_Rakesh Seal.pptx
 
young call girls in Rajiv Chowk🔝 9953056974 🔝 Delhi escort Service
young call girls in Rajiv Chowk🔝 9953056974 🔝 Delhi escort Serviceyoung call girls in Rajiv Chowk🔝 9953056974 🔝 Delhi escort Service
young call girls in Rajiv Chowk🔝 9953056974 🔝 Delhi escort Service
 
GDSC ASEB Gen AI study jams presentation
GDSC ASEB Gen AI study jams presentationGDSC ASEB Gen AI study jams presentation
GDSC ASEB Gen AI study jams presentation
 
Application of Residue Theorem to evaluate real integrations.pptx
Application of Residue Theorem to evaluate real integrations.pptxApplication of Residue Theorem to evaluate real integrations.pptx
Application of Residue Theorem to evaluate real integrations.pptx
 
Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝
Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝
Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝
 
HARMONY IN THE HUMAN BEING - Unit-II UHV-2
HARMONY IN THE HUMAN BEING - Unit-II UHV-2HARMONY IN THE HUMAN BEING - Unit-II UHV-2
HARMONY IN THE HUMAN BEING - Unit-II UHV-2
 
power system scada applications and uses
power system scada applications and usespower system scada applications and uses
power system scada applications and uses
 
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
 
IVE Industry Focused Event - Defence Sector 2024
IVE Industry Focused Event - Defence Sector 2024IVE Industry Focused Event - Defence Sector 2024
IVE Industry Focused Event - Defence Sector 2024
 
Architect Hassan Khalil Portfolio for 2024
Architect Hassan Khalil Portfolio for 2024Architect Hassan Khalil Portfolio for 2024
Architect Hassan Khalil Portfolio for 2024
 
microprocessor 8085 and its interfacing
microprocessor 8085  and its interfacingmicroprocessor 8085  and its interfacing
microprocessor 8085 and its interfacing
 

Fundamental test process

  • 1. FUNDAMENTAL TEST PROCESS by Graham et.al (2011) Yoga Pratama Putra Department of Information System Faculty of Science and Technology State Islamic University of Sultan Syarif Kasim Riau
  • 2. INTRODUCTION In this section, we will describe the fundamental test process and activities. These start with test planning and continue through to test closure. For each part of the test process, we'll discuss the main tasks of each test activity. You'll also encounter the glossary terms confirmation testing, exit criteria, incident, regression testing, test basis, test condition, test coverage, test data, test execution, test log, test plan, test strategy, test summary report and testware.
  • 3. NEXT.. We can divide the activities within the fundamental test process into the following basic steps:  Test planning and control;  Test analysis and design;  Test implementation and execution;  Test evaluating exit criteria and reporting;  Test closure activities.
  • 4. TEST PLANNIG & CONTROL During test planning, we make sure we understand the goals and objectives of the customers, stakeholders, and the project, and the risks which testing is intended to address. This will give us what is sometimes called the mission of testing or the test assignment. Based on this understanding, we set the goals and objectives for the testing itself, and derive an approach and plan for the tests, including specification of test activities. To help us we may have organization or program test policies and a test strategy.
  • 5. NEXT.. Test planning has the follow major tasks, given approxi- mately in order, which help us build a test plan : 1. Determine the scope and risks and identify the objectives of testing 2. Determine the test approach (techniques, test items, coverage, identifying and interfacing with the teams involved in testing, testware) 3. Implement the test policy and/or the test strategy 4. Determine the required test resources (e.g. people, test environment, PCs) 5. Schedule test analysis and design tasks, test implementation, execution and evaluation 6. Determine the exit criteria
  • 6. NEXT.. Test control has the following major tasks : 1. Measure and analyze the results of reviews and testing. 2. Monitor and document progress, test coverage and exit criteria. 3. Provide information actions. 4. Make decisions.
  • 7. TEST ANALYSIS & DESIGN Test analysis and design has the following major tasks, in approximately the following order:  Review the test basis (such as the product risk analysis, requirements, architecture, design specifications, and interfaces), examining the specifications for the software we are testing.  Identify test conditions based on analysis of test items, their specifications, and what we know about their behavior and structure.  Design the test.  Evaluate testability of the requirements and system.
  • 8. TEST IMPLEMENTATIO N & EXECUTION During test implementation and execution, we take the test conditions and make them into test cases and testware and set up the test environment. This means that, having put together a high-level design for our tests, we now start to build them. We transform our test conditions into test cases and procedures, other testware such as scripts for automation. We also need to set up an envi-ronment where we will run the tests and build our test data. Setting up environ- ments and data often involves significant time and effort, so you should plan and monitor this work carefully.
  • 9. NEXT.. Test implementation and execution have the following major tasks, in approximately the following order : 1. implementation :  Develop and prioritize our test cases.  Create test suites from the test cases for efficient test execution.  Implement and verify the environment. 2. Execution :  Execute the test suites and individual test cases, following our test proce dures.  Log the outcome of test execution and record the identities and versions of the software under test, test tools and testware.  Compare actual results (what happened when we ran the tests) with expected results (what we anticipated would happen).  Where there are differences between actual and expected results, report discrepancies as incidents.  Repeat test activities as a result of action taken for each discrepancy.
  • 10. TEST EVALUATING EXIT CRITERIA & REPORTING Evaluating exit criteria is the activity where test execution is assessed against the defined objectives. This should be done for each test level, as for each we need to know whether we have done enough testing. Based on our risk assess- ment, we'll have set criteria against which we'll measure 'enough'. These criteria vary for each project and are known as exit criteria.
  • 11. NEXT.. Evaluating exit criteria has the following major tasks:  Check test logs against the exit criteria specified in test planning: We look to see what evidence we have for which tests have been executed and checked, and what defects have been raised, fixed, confirmation tested, or are out standing.  Assess if more tests are needed or if the exit criteria specified should be changed: We may need to run more tests if we have not run all the tests we designed, or if we realize we have not reached the coverage we expected, or if the risks have increased for the project. We may need to change the exit criteria to lower them, if the business and project risks rise in impor tance and the product or technical risks drop in importance. Note that this is not easy to do and must be agreed with stakeholders. The test manage ment tools and test coverage tools that we'll discuss in Chapter 6 help us with this assessment.  Write a test summary report for stakeholders: It is not enough that the testers know the outcome of the test. All the stakeholders need to know what testing has been done and the outcome of the testing, in order to make informed decisions about the software.
  • 12. TEST CLOSURE ACTIVITIES Test closure activities include the following major tasks:  Check which planned deliverables we actually delivered and ensure all incident reports have been resolved through defect repair or deferral.  Finalize and archive testware, such as scripts, the test environment, and any other test infrastructure, for later reuse.  Hand over testware to the maintenance organization who will support the software and make any bug fixes or maintenance changes, for use in con firmation testing and regression testing.  Evaluate how the testing went and analyze lessons learned for future releases and projects.