The Secret Ingredient of Test Management answers on such questions as "What is ROI?", "What are testing measures ?", "How to improve test process?". "What is Risk-based testing?", " How to manage the team?" etc.
Test Metrics Life Cycle
Test Summary Report
Test Tracking and Efficiency
Test Effort
Test Effectiveness
Test Coverage
Test Economics
Test Team Metrics
Test Management Tools
Test Automation Metrics
Test Automation Metrics
Examples
ID
Task
Mode
Task Name
Duration
Start
Finish
Aug 20, '17
Sep 24, '17
Oct 29, '17
Dec 3, '17
Jan 7, '18
Feb 11, '18
Mar 18, '18
Apr 22, '18
May 27, '18
Jul 1, '18
Aug 5
S
M
T
W
T
F
S
S
M
T
W
T
F
S
S
M
T
W
T
F
S
S
M
T
1
PROJECT DESIGN
63 days
Mon 9/4/17 Wed 11/29/1
2
DEVELOP FUNCTIONAL SPECIFICATIONS
10 days
Mon 9/4/17 Fri 9/15/17
3
DEVELOP SYSTEM ARCHITECTURE
4
DEVELOP PRELIMANARY DESIGN SPECIFICATIONS
20 days
Mon
9/18/17
2.5 days
Mon
10/16/17
Fri 10/13/17
Wed
10/18/17
5
DEVELOP DETAILED DESIGN SPECIFICATIONS
6
DEVELOP ACCEPTANCE TEST PLAN
20 days
Wed
10/18/17
10.5 days
Wed
11/15/17
Wed
11/15/17
Wed
11/29/17
7
PROJECT DEVELOPMENT 157 days
Thu 11/30/1 Fri 7/6/18
8
DEVELOP COMPONENTS
60 days
Thu
11/30/17
Wed
2/21/18
9
PROCURE SOFTWARE
25 days
Thu 2/22/18 Wed 3/28/18
10
PROCURE HARDWARE 25 days
Thu 3/29/18 Wed 5/2/18
11
DEVELOPMENT ACCEPTANCE TEST PACKAGE
12
PERFORM UNIT/INTEGRATION TEST
25 days
Thu 5/3/18
Wed 6/6/18
22 days
Thu 6/7/18
Fri 7/6/18
13
PROJECT DELIVERY
9.5 days
Mon 7/9/18 Fri 7/20/18
14
INSTALL SYSTEM
2 days
Mon 7/9/18 Tue 7/10/18
Project: Web Based Tool
Date: Sun 7/23/17
Task
Split
Milestone
Project Summary
Inactive Task
Inactive Milestone
Manual Task
Duration-only
Manual Summary Rollup
Start-only
Finish-only
External Tasks
Deadline
Progress
Manual Progress
Summary
Inactive Summary
Manual Summary
External Milestone
Page 1
ID
Task
Mode
Task Name
Duration
Start
Finish
Aug 20, '17
Sep 24, '17
Oct 29, '17
Dec 3, '17
Jan 7, '18
Feb 11, '18
Mar 18, '18
Apr 22, '18
May 27, '18
Jul 1, '18
Aug 5
S
M
T
W
T
F
S
S
M
T
W
T
F
S
S
M
T
W
T
F
S
S
M
T
15
TRAIN CUSTOMERS
1 day
Wed 7/11/18 Wed 7/11/18
16
PERFORM ACCEPTANCE 3 days
Thu 7/12/18 Mon
TEST
17
PERFORM POST PROJECT REVIEW
18
PROVIDE WARRANTY SUPPORT
7/16/18
3 days
Tue 7/17/18 Thu 7/19/18
1 day
Tue 7/17/18 Tue 7/17/18
19
ARCHIVE MATERIALS
0.5 days
Fri 7/20/18
Fri 7/20/18
Project: Web Based Tool
Date: Sun 7/23/17
Task
Split
Milestone
Project Summary
Inactive Task
Inactive Milestone
Manual Task
Duration-only
Manual Summary Rollup
Start-only
Finish-only
External Tasks
Deadline
Progress
Manual Progress
Summary
Inactive Summary
Manual Summary
External Milestone
Page 2
7
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
BudgetNew Web Based Tool Budget EstimatePROJECT TASKSLABOR HOURSLABOR COST ($)MATERIAL COST ($)OTHER COST ($)TOTAL PER TASKPROJECT
DESIGNDev.
Test Metrics Life Cycle
Test Summary Report
Test Tracking and Efficiency
Test Effort
Test Effectiveness
Test Coverage
Test Economics
Test Team Metrics
Test Management Tools
Test Automation Metrics
Test Automation Metrics
Examples
ID
Task
Mode
Task Name
Duration
Start
Finish
Aug 20, '17
Sep 24, '17
Oct 29, '17
Dec 3, '17
Jan 7, '18
Feb 11, '18
Mar 18, '18
Apr 22, '18
May 27, '18
Jul 1, '18
Aug 5
S
M
T
W
T
F
S
S
M
T
W
T
F
S
S
M
T
W
T
F
S
S
M
T
1
PROJECT DESIGN
63 days
Mon 9/4/17 Wed 11/29/1
2
DEVELOP FUNCTIONAL SPECIFICATIONS
10 days
Mon 9/4/17 Fri 9/15/17
3
DEVELOP SYSTEM ARCHITECTURE
4
DEVELOP PRELIMANARY DESIGN SPECIFICATIONS
20 days
Mon
9/18/17
2.5 days
Mon
10/16/17
Fri 10/13/17
Wed
10/18/17
5
DEVELOP DETAILED DESIGN SPECIFICATIONS
6
DEVELOP ACCEPTANCE TEST PLAN
20 days
Wed
10/18/17
10.5 days
Wed
11/15/17
Wed
11/15/17
Wed
11/29/17
7
PROJECT DEVELOPMENT 157 days
Thu 11/30/1 Fri 7/6/18
8
DEVELOP COMPONENTS
60 days
Thu
11/30/17
Wed
2/21/18
9
PROCURE SOFTWARE
25 days
Thu 2/22/18 Wed 3/28/18
10
PROCURE HARDWARE 25 days
Thu 3/29/18 Wed 5/2/18
11
DEVELOPMENT ACCEPTANCE TEST PACKAGE
12
PERFORM UNIT/INTEGRATION TEST
25 days
Thu 5/3/18
Wed 6/6/18
22 days
Thu 6/7/18
Fri 7/6/18
13
PROJECT DELIVERY
9.5 days
Mon 7/9/18 Fri 7/20/18
14
INSTALL SYSTEM
2 days
Mon 7/9/18 Tue 7/10/18
Project: Web Based Tool
Date: Sun 7/23/17
Task
Split
Milestone
Project Summary
Inactive Task
Inactive Milestone
Manual Task
Duration-only
Manual Summary Rollup
Start-only
Finish-only
External Tasks
Deadline
Progress
Manual Progress
Summary
Inactive Summary
Manual Summary
External Milestone
Page 1
ID
Task
Mode
Task Name
Duration
Start
Finish
Aug 20, '17
Sep 24, '17
Oct 29, '17
Dec 3, '17
Jan 7, '18
Feb 11, '18
Mar 18, '18
Apr 22, '18
May 27, '18
Jul 1, '18
Aug 5
S
M
T
W
T
F
S
S
M
T
W
T
F
S
S
M
T
W
T
F
S
S
M
T
15
TRAIN CUSTOMERS
1 day
Wed 7/11/18 Wed 7/11/18
16
PERFORM ACCEPTANCE 3 days
Thu 7/12/18 Mon
TEST
17
PERFORM POST PROJECT REVIEW
18
PROVIDE WARRANTY SUPPORT
7/16/18
3 days
Tue 7/17/18 Thu 7/19/18
1 day
Tue 7/17/18 Tue 7/17/18
19
ARCHIVE MATERIALS
0.5 days
Fri 7/20/18
Fri 7/20/18
Project: Web Based Tool
Date: Sun 7/23/17
Task
Split
Milestone
Project Summary
Inactive Task
Inactive Milestone
Manual Task
Duration-only
Manual Summary Rollup
Start-only
Finish-only
External Tasks
Deadline
Progress
Manual Progress
Summary
Inactive Summary
Manual Summary
External Milestone
Page 2
7
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
�
BudgetNew Web Based Tool Budget EstimatePROJECT TASKSLABOR HOURSLABOR COST ($)MATERIAL COST ($)OTHER COST ($)TOTAL PER TASKPROJECT
DESIGNDev.
In this presentation we are going to summarize and share with you QA estimation approach that was developed and successfully applied on different projects at Testing Center of Excellence at Ciklum. We will consider factors and basis which should be considered while starting estimation process, QA Estimation approach for main and additional activities should be taken into account, try to compose estimation guide for Regression testing and find out how to adjust QA Estimation by risks/assumptions multipliers.
Isabel Evans - Working Ourselves out of a Job: A Passion For Improvement - Eu...TEST Huddle
EuroSTAR Software Testing Conference 2010 presentation on Working Ourselves out of a Job: A Passion For Improvement by Isabel Evans.
See more at: http://conference.eurostarsoftwaretesting.com/past-presentations/
Neil Thompson - Value Inspired Testing: Renovating Risk-Based Testing and Inn...TEST Huddle
EuroSTAR Software Testing Conference 2012 presentation on Value Inspired Testing: Renovating Risk-Based Testing and Innovating with Emergence by Neil Thompson.
See more at: http://conference.eurostarsoftwaretesting.com/past-presentations/
Software testing metrics | David Tzemach David Tzemach
Overview
What we can measure using metrics
Common metrics to evaluate test process
why do we need to use metrics
Test metrics life cycle (TMLC)
Type of metrics
Fundamental testing metrics
✔️ OWASP Top 10 in 2020
✔️ SQL injections classification
✔️ How to avoid and protect your app
✔️ Examples of how to use SQL injections on real websites.
Vladimir Arutin (QA engineer in HYS Enterprise) and Nikolay Tsyb (Java Engineer in Oracle Ukraine) will share their experience and tell how QA and Dev can help each other when working on product creation, as well as about the productive collaboration of these two branches.
We’ll talk about:
Google old swagger, and why we’re fond of it
Microservices contract testing, or why a deal is a deal
Ordered chaos as an alternative to the arrangement
Use of PACT and act
How to hedge your microservices’ work
Advantages of Consumer-Driven Contract over end-to-end tests
Dev/QA symbiosis or “per aspera ad astra” (to the stars by hard ways)
In this presentation we are going to summarize and share with you QA estimation approach that was developed and successfully applied on different projects at Testing Center of Excellence at Ciklum. We will consider factors and basis which should be considered while starting estimation process, QA Estimation approach for main and additional activities should be taken into account, try to compose estimation guide for Regression testing and find out how to adjust QA Estimation by risks/assumptions multipliers.
Isabel Evans - Working Ourselves out of a Job: A Passion For Improvement - Eu...TEST Huddle
EuroSTAR Software Testing Conference 2010 presentation on Working Ourselves out of a Job: A Passion For Improvement by Isabel Evans.
See more at: http://conference.eurostarsoftwaretesting.com/past-presentations/
Neil Thompson - Value Inspired Testing: Renovating Risk-Based Testing and Inn...TEST Huddle
EuroSTAR Software Testing Conference 2012 presentation on Value Inspired Testing: Renovating Risk-Based Testing and Innovating with Emergence by Neil Thompson.
See more at: http://conference.eurostarsoftwaretesting.com/past-presentations/
Software testing metrics | David Tzemach David Tzemach
Overview
What we can measure using metrics
Common metrics to evaluate test process
why do we need to use metrics
Test metrics life cycle (TMLC)
Type of metrics
Fundamental testing metrics
✔️ OWASP Top 10 in 2020
✔️ SQL injections classification
✔️ How to avoid and protect your app
✔️ Examples of how to use SQL injections on real websites.
Vladimir Arutin (QA engineer in HYS Enterprise) and Nikolay Tsyb (Java Engineer in Oracle Ukraine) will share their experience and tell how QA and Dev can help each other when working on product creation, as well as about the productive collaboration of these two branches.
We’ll talk about:
Google old swagger, and why we’re fond of it
Microservices contract testing, or why a deal is a deal
Ordered chaos as an alternative to the arrangement
Use of PACT and act
How to hedge your microservices’ work
Advantages of Consumer-Driven Contract over end-to-end tests
Dev/QA symbiosis or “per aspera ad astra” (to the stars by hard ways)
Экстремальный проектный менеджмент. Набор и управление командойVladimir Arutin
Доклад не похож на традиционные советы по набору персонала, а содержит "черные" скрипты управления. Как именно нужно набирать сотрудников, управлять командой и правильно мотивировать к действию. Каким должен быть руководитель и почему дружный коллектив это не всегда хорошо. Классификация групп сотрудников и приёмы воздействия.
Доклад расчитан для тех, кто собирается связать свою жизнь с миром тестирования программного обеспечения или только начал осваивать профессию тестировщика. Собраны самые популярные мифы о тестировании, в основе которых которых лежат ложные стереотип и представления о QA.
How to use pairwise testing on your projects.
The main idea.
Mechanism of calculation.
Secrets and tools.
PICT.
Testing Techniques in Software Testing
Orthogonal arrays
ACTs
When All Teammates Speak The Same Language
Two main problems in software development
It's all about brains
What is BDD?
BDD vs TDD vs ATDD
Three Amigos
Gherkin
Cucumber and Selenium WebDriver
How to use feature files and create steps definitions
Examples
Student information management system project report ii.pdfKamal Acharya
Our project explains about the student management. This project mainly explains the various actions related to student details. This project shows some ease in adding, editing and deleting the student details. It also provides a less time consuming process for viewing, adding, editing and deleting the marks of the students.
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Dr.Costas Sachpazis
Terzaghi's soil bearing capacity theory, developed by Karl Terzaghi, is a fundamental principle in geotechnical engineering used to determine the bearing capacity of shallow foundations. This theory provides a method to calculate the ultimate bearing capacity of soil, which is the maximum load per unit area that the soil can support without undergoing shear failure. The Calculation HTML Code included.
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdffxintegritypublishin
Advancements in technology unveil a myriad of electrical and electronic breakthroughs geared towards efficiently harnessing limited resources to meet human energy demands. The optimization of hybrid solar PV panels and pumped hydro energy supply systems plays a pivotal role in utilizing natural resources effectively. This initiative not only benefits humanity but also fosters environmental sustainability. The study investigated the design optimization of these hybrid systems, focusing on understanding solar radiation patterns, identifying geographical influences on solar radiation, formulating a mathematical model for system optimization, and determining the optimal configuration of PV panels and pumped hydro storage. Through a comparative analysis approach and eight weeks of data collection, the study addressed key research questions related to solar radiation patterns and optimal system design. The findings highlighted regions with heightened solar radiation levels, showcasing substantial potential for power generation and emphasizing the system's efficiency. Optimizing system design significantly boosted power generation, promoted renewable energy utilization, and enhanced energy storage capacity. The study underscored the benefits of optimizing hybrid solar PV panels and pumped hydro energy supply systems for sustainable energy usage. Optimizing the design of solar PV panels and pumped hydro energy supply systems as examined across diverse climatic conditions in a developing country, not only enhances power generation but also improves the integration of renewable energy sources and boosts energy storage capacities, particularly beneficial for less economically prosperous regions. Additionally, the study provides valuable insights for advancing energy research in economically viable areas. Recommendations included conducting site-specific assessments, utilizing advanced modeling tools, implementing regular maintenance protocols, and enhancing communication among system components.
Courier management system project report.pdfKamal Acharya
It is now-a-days very important for the people to send or receive articles like imported furniture, electronic items, gifts, business goods and the like. People depend vastly on different transport systems which mostly use the manual way of receiving and delivering the articles. There is no way to track the articles till they are received and there is no way to let the customer know what happened in transit, once he booked some articles. In such a situation, we need a system which completely computerizes the cargo activities including time to time tracking of the articles sent. This need is fulfilled by Courier Management System software which is online software for the cargo management people that enables them to receive the goods from a source and send them to a required destination and track their status from time to time.
Water scarcity is the lack of fresh water resources to meet the standard water demand. There are two type of water scarcity. One is physical. The other is economic water scarcity.
Explore the innovative world of trenchless pipe repair with our comprehensive guide, "The Benefits and Techniques of Trenchless Pipe Repair." This document delves into the modern methods of repairing underground pipes without the need for extensive excavation, highlighting the numerous advantages and the latest techniques used in the industry.
Learn about the cost savings, reduced environmental impact, and minimal disruption associated with trenchless technology. Discover detailed explanations of popular techniques such as pipe bursting, cured-in-place pipe (CIPP) lining, and directional drilling. Understand how these methods can be applied to various types of infrastructure, from residential plumbing to large-scale municipal systems.
Ideal for homeowners, contractors, engineers, and anyone interested in modern plumbing solutions, this guide provides valuable insights into why trenchless pipe repair is becoming the preferred choice for pipe rehabilitation. Stay informed about the latest advancements and best practices in the field.
Immunizing Image Classifiers Against Localized Adversary Attacksgerogepatton
This paper addresses the vulnerability of deep learning models, particularly convolutional neural networks
(CNN)s, to adversarial attacks and presents a proactive training technique designed to counter them. We
introduce a novel volumization algorithm, which transforms 2D images into 3D volumetric representations.
When combined with 3D convolution and deep curriculum learning optimization (CLO), itsignificantly improves
the immunity of models against localized universal attacks by up to 40%. We evaluate our proposed approach
using contemporary CNN architectures and the modified Canadian Institute for Advanced Research (CIFAR-10
and CIFAR-100) and ImageNet Large Scale Visual Recognition Challenge (ILSVRC12) datasets, showcasing
accuracy improvements over previous techniques. The results indicate that the combination of the volumetric
input and curriculum learning holds significant promise for mitigating adversarial attacks without necessitating
adversary training.
Automobile Management System Project Report.pdfKamal Acharya
The proposed project is developed to manage the automobile in the automobile dealer company. The main module in this project is login, automobile management, customer management, sales, complaints and reports. The first module is the login. The automobile showroom owner should login to the project for usage. The username and password are verified and if it is correct, next form opens. If the username and password are not correct, it shows the error message.
When a customer search for a automobile, if the automobile is available, they will be taken to a page that shows the details of the automobile including automobile name, automobile ID, quantity, price etc. “Automobile Management System” is useful for maintaining automobiles, customers effectively and hence helps for establishing good relation between customer and automobile organization. It contains various customized modules for effectively maintaining automobiles and stock information accurately and safely.
When the automobile is sold to the customer, stock will be reduced automatically. When a new purchase is made, stock will be increased automatically. While selecting automobiles for sale, the proposed software will automatically check for total number of available stock of that particular item, if the total stock of that particular item is less than 5, software will notify the user to purchase the particular item.
Also when the user tries to sale items which are not in stock, the system will prompt the user that the stock is not enough. Customers of this system can search for a automobile; can purchase a automobile easily by selecting fast. On the other hand the stock of automobiles can be maintained perfectly by the automobile shop manager overcoming the drawbacks of existing system.
Final project report on grocery store management system..pdfKamal Acharya
In today’s fast-changing business environment, it’s extremely important to be able to respond to client needs in the most effective and timely manner. If your customers wish to see your business online and have instant access to your products or services.
Online Grocery Store is an e-commerce website, which retails various grocery products. This project allows viewing various products available enables registered users to purchase desired products instantly using Paytm, UPI payment processor (Instant Pay) and also can place order by using Cash on Delivery (Pay Later) option. This project provides an easy access to Administrators and Managers to view orders placed using Pay Later and Instant Pay options.
In order to develop an e-commerce website, a number of Technologies must be studied and understood. These include multi-tiered architecture, server and client-side scripting techniques, implementation technologies, programming language (such as PHP, HTML, CSS, JavaScript) and MySQL relational databases. This is a project with the objective to develop a basic website where a consumer is provided with a shopping cart website and also to know about the technologies used to develop such a website.
This document will discuss each of the underlying technologies to create and implement an e- commerce website.
TECHNICAL TRAINING MANUAL GENERAL FAMILIARIZATION COURSEDuvanRamosGarzon1
AIRCRAFT GENERAL
The Single Aisle is the most advanced family aircraft in service today, with fly-by-wire flight controls.
The A318, A319, A320 and A321 are twin-engine subsonic medium range aircraft.
The family offers a choice of engines
2. ABOUT MYSELF
VLADIMIR ARUTIN
QA ENGINEER
at HYS ENTERPRISE
ISTQB CERTIFIED TEST MANAGER
ISTQB Training Instructor
Quality Assurance Training Instructor
Speaker
3.
4. TEST MANAGEMENT – planning, scheduling,
estimating, monitoring, reporting, control and
completion of test activities.
*Ref: ISO 29119
WHAT IS TEST MANAGEMENT?
5. WHY DO WE NEED TEST MANAGEMENT?
“Тестирование - это искусство
сравнивания невидимого с
противоречивым, чтобы
предотвратить немыслимое,
случившееся с неизвестным.”
8. TEST MANAGER’S RESPONSIBILITIES
• BULDING UP AND LEADING THE TESTING TEAM
• DEFINING THE SCOPE OF TESTING
• DEPLOYING AND MANAGING RECOURCES FOR TESTING
• APPLYING THE APPROPRIATE TEST MEASUREMENTS AND METRICS
• PLANNING, DEPLOYING AND MANGING
• ASSESSING THE PROGRESS AND EFFECTIVENESS OF THE TEST EFFORT
• ADVOCATING THE APPROPRIATE LEVEL OF TESTABILITY
• ADVOCATING THE APPROPRIATE LEVEL OF QUALITY
9. WHAT ARE THE CHALLENGES IN TEST MANAGEMENT?
NOT ENOUGH TIME TO TEST
NOT ENOUGH RECOURCES TO TEST
THE PROJECT BUDGET IS LOW
AND SCHEDULE IS TOO TIGHT
TESTING TEAMS ARE NOT ALWAYS IN ONE PLACE
THE REQUIREMENTS ARE TOO COMPLEX
TO CHECK AND VALIDATE
10. MAIN PROBLEM
HEY YOU!
TEST THIS APPLICATION
TO ENSURE HIGH
QUALITY!
OKAY, BUT I NEED
PEOPLE, BUDGET,
TIME… LET ME
CREATE A TEST PLAN
FOR HIGH QUALITY
TESTING.
BOSS
TM
11. LOOK! HERE IS MY TEST PLAN.
AT FIRST SIGHT IT COSTS
A LOT, BUT ALL THESE ACTIVITIES
ARE NECESSARY FOR GOOD
TESTING.
WHAT?!! COST IS TOO
HIGH! CUT YOUR
BUDGET IN 4 TIMES!!!
AND FINISH THE PROGECT
IN HALF TIME!!!
12. YOU HAVE 1 DAY TO PRESENT COMPLETE
TEST PLAN BASED ON THE APPROVED
BUDGET!
IF YOU CAN’T TO IT, WE’LL FIND ANOTHER
TEST MANGEMENT WHO CAN!
16. 1. Decide What to Automate
2. Prioritize & Divide Tasks
3. Prepare Test Cases & Scenario Beforehand
4. Create Tests that Don’t Affect UI Changes
5. Don’t Automate Every Test
6. Review Tests Periodically
7. Compare Your Costs And Benefits
CALCULATE YOUR COSTS
18. 7 Principles of TESTING
1. Exhaustive testing is not possible
2. Defect Clustering
3. Pesticide Paradox
4. Testing shows a presence of defects
5. Absence of Error - fallacy
6. Early Testing
7. Testing is context dependent
10 Principles for Agile
Testers
1. Provide Continuous Feedback
2. Deliver Value to the Customer
3. Enable Face-to-Face Communication
4. Have Courage
5. Keep It Simple
6. Practice Continuous Improvement
7. Respond to Change
8. Self-Organize
9. Focus on People
10. Enjoy
USE TEST MANAGEMENT PRINCIPLES
24. USE TEST METRICS. MEASURE AND RULE!
Test Effort
How long, how many,
and how much?
25. USE TEST METRICS. MEASURE AND RULE!
Test Effectiveness
Defect Detection Percentage =
(DDP)
Defects found by testing stage
Total defects found in all stages
27. Defect Density = No. of Defects identified / size
No. of Defects identified 30
No. of requirements 5
Others
Defect Density = (30 / 5) = 6
Defect Removal Efficiency (DRE)
No. of Defects found while Testing + No. of Defects found by User
DRE= х100%
120
No. of Defects found by User 42
No. of Defects found while Testing
No. of Defects found while Testing
DRE = [120 / (120 + 42)] * 100 = [120 /162] * 100 = 74.07%
28. Others
х100%
120
No. of Defects found by User 42
No. of Defects found while Testing
Example, QA team reported 100 defects out
of which 20 were invalid(not bugs, duplicates,
etc.) and only 65 were fixed
Defect gap % is: (65/100-20)X100= 81%
Defect Gap =
Total No. of Valid Defects reported)
Total No. of Defects Fixed
29. Others
Total RawTest Steps
TestCaseProductivity = Step(s)/hour
Efforts(hours)
Test Case Name Raw Steps
XYZ_1 30
XYZ_2 32
XYZ_3 40
XYZ_4 36
XYZ_5 45
Total Raw Steps 183
Efforts took for writing 183 steps
is 8 hours.
TCP=183/8=22.8
Test case productivity = 23 steps/hour
30. Test Automation Metrics
AP (%) =
Automation Progress
# of actual test cases automated
# of test cases automatable
Test Progress
TP (%) =
# of test cases (attempted or completed)
time (days/weeks/months, etc)
Percent of Automated Testing Test Coverage
PTC( (%) =
automation coverage )
total coverage
32. SCRIPTS FOR SUCCESS
BEGIN THE TESTING ACTIVITIES EARLY IN THE SDLC
REUSE TEST ASSETS AND IMPROVE TIME SPENT EVERY TIME
ENSURE PROPER COORDINATION BETWEEN CO-LOCATED TESTING
RECOURCES
DEFINE & ENFORCE FLEXIBLE TESTING PROCESSES
COORDINATE & INTERGRATE WITH DEV TEAMS –
USE DEVOPS SHIFT LEFT PRACTICE
COMMUNICATE THE CORRECT STATUS AT THE RIGHT TIME
TO SAVE TIME, AUTOMATE, AUTOMATE, AUTOMATE!
33. SCRIPTS FOR SUCCESS
PLAN, DO, CONTROL AND STANDARDIZE!
RECOGNIZE PROBLEMS.
IT’S COOL BECAUSE NOW YOU CAN FIX THEM.
DOCUMENT ALL SOLUTIONS AND RESULTS
EACH DAY –NEW SMALL IMPROVEMENTS
INVOLVE ALL STAFF WHILE MAKING DECISIONS
IF YOU DO SOMETHING BE SURE IT WILL STAY THAT WAY
YOU DID IT. SO DO IT PROPERLY AT ONCE.
ALL THE WORK ON THE PROJECT SHOULD BE CONSIDERED
THROUGH THE LENS OF COMPANY DISTANT TARGETS FOR
FUTURE GROWTH.
36. TEST PROCESS IMPROVEMENT (TPI) NEXT
TPI NEXT: A continuous business-driven framework for test process improvement
that describes the key elements of an effective and efficient test process.
16 KEY PROCESS AREAS:
1. Stakeholder commitment
2. Degree of involvement
3. Test Strategy
4. Test Organization
5. Communication
6. Reporting
7. Test Process Management
8. Estimating and Planning
9. Metrics
10. Defect Management
11. Testware Management
12. Methodology Practice
13. Tester Professionalism
14. Test Case Design
15. Test Tools
16. Test Environment
39. CRITICAL TESTING PROCESS (CTP)
CRITICAL TESTING PROCESSE (CTP): A content-based model for test process
improvement built around twelve critical processes.
12 CRITICAL PROCESSES:
1. TESTING
2. ESTABLISHING CONTEXT
3. QUALITY RISK ANALYSIS
4. TEST ESTIMATION
5. TEST PLANNING
6. TEST TEAM DEVELOPMENT
7. TEST SYSTEM DEVELOPMENT
8. TEST RELEASE MANAGEMENT
9. TEST EXECUTION
10. BUG REPORTING
11. RESULTS REPORTING
12. CHANGE MANAGEMENT
40. SYSTEMATIC TEST AND EVALUATION PROCESS
(STEP)
SYSTEM TEST AND EVALUATING PROCESS (STEP): A structured testing methodology,
also used as a content-based model for improving the testing process which doesn’t
require that improvements occur in a specific order.
Basic premises of the methodology include:
• A requirement-based strategy
• Testing starts at the beginning of the lifecycle
• Tests are used as requirements and usage models
• Testware design leads software design
• Defects are detected earlier or prevented
altogether
• Defects are systematically analyzed
• Testers and developers work together
41. TESTING MATURITY MODEL integration
(TMMi)
TESTING MATURITY MODEL intergation (TMMi) is composed of 5 maturity levels
and is intended to complement CMMI. Each of the maturity level contains defined
process areas that must be 85% complete by achieving specific and generic goals
before the organization can advance to the next level.
72. + –
” 0 Y^ y + ”
ПОКА ДЕФЕКТ НЕ ИСПРАВЛЕН, РИСК В ПРОДУКТЕ
ОСТАЕТСЯ
‘RISK ELIMINATION’: РИСК УСТРАНЯЕТСЯ В
РЕЗУЛЬТАТЕ СПРАВЛЕНИЯ И ВЕРИФИКАЦИИ
ДЕФЕКТА
‘RISK ACCEPTION’: РИСК ПРИНИМАЕТСЯ, КОГДА
ОБНАРУЖЕННЫЙ ДЕФЕКТ РЕШЕНО НЕ ИСПРАВЛЯТЬ
‘RISK SHARING’: КОГДА НЕ ИСПРАВЛЯЕТСЯ
СЕРЬЕЗНЫЙ ДЕФЕКТ, ЕГО ОБІЧНО ДЕЛЯТ:
- С МЕНЕДЖЕРОМ ПРОЕКТА (проектное совещание)
- С ЗАКАЗЧИКОМ (в ходе сдачи-приемки)
- С ПОЛЬЗОВАТЕЛЕМ (описание дефекта в
сопроводительной документации)
‘RISK AVOIDANCE’: ИНОГДА МЫ ПРОЬУЕМ ИЗБЕЖАТЬ
РИСКА
-переписать фрагмент кода с дефектами
- Урезать код (даже путем сокращения функционала)
103. You have completed the following skills assessment for your team, rating each
person from 1 (low) to 5 (high) for their competency in each area
You are in the middle of a very technical project with significant problems. Tester D
is quite junior and needs frequent guidance. You have to go on vacation for the
next two weeks. Who is the best person on your team to handle the test
management tasks while you are gone?
a. Tester A
b. Tester B
c. Tester C
d. Tester E
104. You have completed the following skills assessment for your team, rating each
person from 1 (low) to 5 (high) for their competency in each area
You are in the middle of a very technical project with significant problems. Tester D
is quite junior and needs frequent guidance. You have to go on vacation for the
next two weeks. Who is the best person on your team to handle the test
management tasks while you are gone?
a. Tester A
b. Tester B
c. Tester C
d. Tester E
105. You have completed the following skills assessment for your team, rating
each person from 1 (low) to 5 (high) for their competency in each area.
You have an opportunity to send one of your testers to speak at a conference on the
importance of technical testing skills in software testing. This person will also be expected to
attend other seminars and bring back and disseminate that information to the team. Who is
the best candidate for this opportunity?
a. Tester A
b. Tester C
c. Tester D
d. Tester E
106. You have completed the following skills assessment for your team, rating
each person from 1 (low) to 5 (high) for their competency in each area.
You have an opportunity to send one of your testers to speak at a conference on the
importance of technical testing skills in software testing. This person will also be expected to
attend other seminars and bring back and disseminate that information to the team. Who is
the best candidate for this opportunity?
a. Tester A
b. Tester C
c. Tester D
d. Tester E
107. You have completed the following skills assessment for your team, rating
each person from 1 (low) to 5 (high) for their competency in each area.
You have a limited training budget, but you can afford to send two people to a course on peer
coaching. In order to best benefit the department, who should you send to this training?
a. Testers C and D
b. Testers A and C
c. Testers B and E
d. Testers B and D
108. You have completed the following skills assessment for your team, rating
each person from 1 (low) to 5 (high) for their competency in each area.
You have a limited training budget, but you can afford to send two people to a course on peer
coaching. In order to best benefit the department, who should you send to this training?
a. Testers C and D
b. Testers A and C
c. Testers B and E
d. Testers B and D