This document describes a study on improving the efficiency of test analysis through utilizing test categories based on application under test (AUT) knowledge and known faults. The study proposes a method for defining test categories based on logical structures of features to guide test condition determination. A verification experiment was conducted and showed measurable improvement in test coverage when using the proposed method. The method aims to minimize variability in test analysis results by providing a standardized process for testers to follow.
A Test Analysis Method for Black Box Testing Using AUT and Fault Knowledge.Tsuyoshi Yumoto
With a rapid increase in size and complexity of software today, the scope of software testing is also expanding. The efficiency of software testing needs to be improved in order to ensure the appropriate delivery deadline and cost of software development. For improving efficiency of software testing, the test needs to be designed in a way that the number of test cases is sufficient and appropriate in quantity. Test analysis is the activity to refine Application Under Test (AUT) into proper size that test design techniques can be applied to. It is for designing the test properly. However, the classification for proper size depends on individual’s own judgments. This paper proposes a test analysis method for the black box testing using a test category that is the classification based on fault and AUT knowledge.
This presentation provides an overview of such basic terms as "test design" and "test cases", software design testing lifecycle and test design techniques. Next, the focus is set on four black-box techniques, namely Boundary value analysis, Equivalence partitioning, Decision tables and State transition.
This presentation by Tetiana Trushchenko (Test Engineer, Consultant, GlobalLogic), was delivered at GlobalLogic Mykolaiv QA Workshop on July 7, 2018.
Whitepaper Test Case Design and Testing Techniques- Factors to ConsiderRapidValue
Software testing is an essential and important technique for assessing the quality of a particular software product/service. In software testing, test cases and scenarios play an inevitable and a pivotal role. A good strategic design and technique help to improve the quality of the software testing process.
This whitepaper provides information about test case design activities, test analysis, quality risks, testing techniques, phases of test development. The paper also, explains the factors that need to be considered while choosing the right testing techniques and provides a checklist of test cases based on our rich experience of testing mobile apps.
A Test Analysis Method for Black Box Testing Using AUT and Fault Knowledge.Tsuyoshi Yumoto
With a rapid increase in size and complexity of software today, the scope of software testing is also expanding. The efficiency of software testing needs to be improved in order to ensure the appropriate delivery deadline and cost of software development. For improving efficiency of software testing, the test needs to be designed in a way that the number of test cases is sufficient and appropriate in quantity. Test analysis is the activity to refine Application Under Test (AUT) into proper size that test design techniques can be applied to. It is for designing the test properly. However, the classification for proper size depends on individual’s own judgments. This paper proposes a test analysis method for the black box testing using a test category that is the classification based on fault and AUT knowledge.
This presentation provides an overview of such basic terms as "test design" and "test cases", software design testing lifecycle and test design techniques. Next, the focus is set on four black-box techniques, namely Boundary value analysis, Equivalence partitioning, Decision tables and State transition.
This presentation by Tetiana Trushchenko (Test Engineer, Consultant, GlobalLogic), was delivered at GlobalLogic Mykolaiv QA Workshop on July 7, 2018.
Whitepaper Test Case Design and Testing Techniques- Factors to ConsiderRapidValue
Software testing is an essential and important technique for assessing the quality of a particular software product/service. In software testing, test cases and scenarios play an inevitable and a pivotal role. A good strategic design and technique help to improve the quality of the software testing process.
This whitepaper provides information about test case design activities, test analysis, quality risks, testing techniques, phases of test development. The paper also, explains the factors that need to be considered while choosing the right testing techniques and provides a checklist of test cases based on our rich experience of testing mobile apps.
As testers, we know that we can define many more test cases than we will ever have time to design, execute, and report. The key problem in testing is choosing a small, “smart” subset from the almost infinite number of tests available that will find a large percentage of the defects. Join Lee Copeland to discover how to design test cases using formal black-box techniques, including equivalence class testing, boundary value testing, decision tables, and state-transition diagrams. Explore examples of each of these techniques in action. Don’t just pick test cases at random. Rather, learn to selectively choose a set of test cases that maximizes your effectiveness and efficiency to find more defects in less time. Then, learn how to use the test results to evaluate the quality of both your products and your testing. Discover the test design techniques that will make your testing more productive.
In this session you will learn:
Test Case Design and Techniques
Black-box: Three major approaches
Steps for drawing cause-Effect Diagram:
Behavior Testing
Random Testing
White Box Techniques
Path Testing
Statement Coverage
Data Flow Testing
For more information: https://www.mindsmapped.com/courses/quality-assurance/qa-software-testing-training-for-beginners/
Code coverage based test case selection and prioritizationijseajournal
Regression Testing is exclusively executed to guarantee the desirable functionality of existing software
after pursuing quite a few amendments or variations in it. Perhaps, it testifies the quality of the modified
software by concealing the regressions or
software bugs in both functional and non
-
functional applications
of the system. In fact, the maintenance of test suite is enormous as it necessitates a big investment of time
and money on test cases on a large scale. So, minimizing the test suite becomes
the indispensable requisite
to lessen the budget on regression testing. Precisely, this research paper aspires to present an innovative
approach for the effective
selection and prioritization of test cases which in return may procure a maximum
code average
EXTRACTING THE MINIMIZED TEST SUITE FOR REVISED SIMULINK/STATEFLOW MODELijaia
Test case generation techniques are successfully employed to generate test cases from a formal model. A problem is that as the model evolves, test suites tend to grow in size, making it too costly to execute entire test suites. This paper aims to propose a practical approach to reduce the size of test suites for modified Simulink/Stateflow (SL/SF) model, which is popularly used for modeling software behavior in many industries like automobile manufacturers. The model for describing a system is frequently modified until it is fixed. The proposed technique is capable of extracting the minimized sized test suite in terms of test coverage, by taking into account both the modified and the affected portion of revised SL/SF model. Two real models for the ECUs deployed in a commercial car are used for an empirical study.
As testers, we know that we can define many more test cases than we will ever have time to design, execute, and report. The key problem in testing is choosing a small, “smart” subset from the almost infinite number of tests available that will find a large percentage of the defects. Join Lee Copeland to discover how to design test cases using formal black-box techniques, including equivalence class testing, boundary value testing, decision tables, and state-transition diagrams. Explore examples of each of these techniques in action. Don’t just pick test cases at random. Rather, learn to selectively choose a set of test cases that maximizes your effectiveness and efficiency to find more defects in less time. Then, learn how to use the test results to evaluate the quality of both your products and your testing. Discover the test design techniques that will make your testing more productive.
In this session you will learn:
Test Case Design and Techniques
Black-box: Three major approaches
Steps for drawing cause-Effect Diagram:
Behavior Testing
Random Testing
White Box Techniques
Path Testing
Statement Coverage
Data Flow Testing
For more information: https://www.mindsmapped.com/courses/quality-assurance/qa-software-testing-training-for-beginners/
Code coverage based test case selection and prioritizationijseajournal
Regression Testing is exclusively executed to guarantee the desirable functionality of existing software
after pursuing quite a few amendments or variations in it. Perhaps, it testifies the quality of the modified
software by concealing the regressions or
software bugs in both functional and non
-
functional applications
of the system. In fact, the maintenance of test suite is enormous as it necessitates a big investment of time
and money on test cases on a large scale. So, minimizing the test suite becomes
the indispensable requisite
to lessen the budget on regression testing. Precisely, this research paper aspires to present an innovative
approach for the effective
selection and prioritization of test cases which in return may procure a maximum
code average
EXTRACTING THE MINIMIZED TEST SUITE FOR REVISED SIMULINK/STATEFLOW MODELijaia
Test case generation techniques are successfully employed to generate test cases from a formal model. A problem is that as the model evolves, test suites tend to grow in size, making it too costly to execute entire test suites. This paper aims to propose a practical approach to reduce the size of test suites for modified Simulink/Stateflow (SL/SF) model, which is popularly used for modeling software behavior in many industries like automobile manufacturers. The model for describing a system is frequently modified until it is fixed. The proposed technique is capable of extracting the minimized sized test suite in terms of test coverage, by taking into account both the modified and the affected portion of revised SL/SF model. Two real models for the ECUs deployed in a commercial car are used for an empirical study.
Focused Exploration of Geospatial Context on Linked Open DataThomas Gottron
Talk at IESD 2014 workshop in Riva del Garda (at ISWC).
Abstract The Linked Open Data cloud provides a wide range of different types of information which are interlinked and connected. When a user or application is interested in specific types of information under time constraints it is best to ex- plore this vast knowledge network in a focused and directed way. In this paper we address the novel task of focused exploration of Linked Open Data for geospatial resources, helping journalists in real-time during breaking news stories to find contextual geospatial information related to geoparsed content. After formalising the task of focused exploration, we present and evaluate five approaches based on three different paradigms. Our results on a dataset with 425,338 entities show that focused exploration on the Linked Data cloud is feasible and can be implemented at very high levels of accuracy of more than 98%.
In this chapter, we will introduce you to the fundamentals of testing: why testing is needed; its limitations, objectives and purpose; the principles behind testing; the process that testers follow; and some of the psychological factors that testers must consider in their work. By reading this chapter you'll gain an understanding of the fundamentals of testing and be able to describe those fundamentals.
A NOVEL APPROACH FOR TEST CASEPRIORITIZATIONIJCSEA Journal
Test case prioritization techniques basically schedule the execution of test cases in a definite order such that to attain an objective function with greater efficiency. This scheduling of test cases improves the results of regression testing. Test case prioritization techniques order the test cases such that the most important ones are executed first encountering the faults first and thus makes the testing effective. In this paper an approach is presented which calculates the product of statement coverage and function calls. The results illustrate the effectiveness of formula computed with the help of APFD metric.
Calibration and Validation of Micro-Simulation ModelsWSP
Calibration and Validation of Micro-Simulation Models is a presentation delivered by François Bélisle, Eng., B.Sc., M.Sc., WSP | Parsons Brinckerhoff, Laurent Gauthier, Polytechnique Montréal and Nicolas Saunier, Polytechnique Montréal at the 2015 Transportation Association of Canada (TAC) Conference & Exhibition, from September 27 to 30.
• Cooperated with fellow colleagues in a lab environment and experimented on the science of fluid flow through various types of piping and fittings.
• Researched the head loss that is caused in different piping including Venturi pipe, orifice plate, and elbow pipe fittings.
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...Amil Baba Dawood bangali
Contact with Dawood Bhai Just call on +92322-6382012 and we'll help you. We'll solve all your problems within 12 to 24 hours and with 101% guarantee and with astrology systematic. If you want to take any personal or professional advice then also you can call us on +92322-6382012 , ONLINE LOVE PROBLEM & Other all types of Daily Life Problem's.Then CALL or WHATSAPP us on +92322-6382012 and Get all these problems solutions here by Amil Baba DAWOOD BANGALI
#vashikaranspecialist #astrologer #palmistry #amliyaat #taweez #manpasandshadi #horoscope #spiritual #lovelife #lovespell #marriagespell#aamilbabainpakistan #amilbabainkarachi #powerfullblackmagicspell #kalajadumantarspecialist #realamilbaba #AmilbabainPakistan #astrologerincanada #astrologerindubai #lovespellsmaster #kalajaduspecialist #lovespellsthatwork #aamilbabainlahore#blackmagicformarriage #aamilbaba #kalajadu #kalailam #taweez #wazifaexpert #jadumantar #vashikaranspecialist #astrologer #palmistry #amliyaat #taweez #manpasandshadi #horoscope #spiritual #lovelife #lovespell #marriagespell#aamilbabainpakistan #amilbabainkarachi #powerfullblackmagicspell #kalajadumantarspecialist #realamilbaba #AmilbabainPakistan #astrologerincanada #astrologerindubai #lovespellsmaster #kalajaduspecialist #lovespellsthatwork #aamilbabainlahore #blackmagicforlove #blackmagicformarriage #aamilbaba #kalajadu #kalailam #taweez #wazifaexpert #jadumantar #vashikaranspecialist #astrologer #palmistry #amliyaat #taweez #manpasandshadi #horoscope #spiritual #lovelife #lovespell #marriagespell#aamilbabainpakistan #amilbabainkarachi #powerfullblackmagicspell #kalajadumantarspecialist #realamilbaba #AmilbabainPakistan #astrologerincanada #astrologerindubai #lovespellsmaster #kalajaduspecialist #lovespellsthatwork #aamilbabainlahore #Amilbabainuk #amilbabainspain #amilbabaindubai #Amilbabainnorway #amilbabainkrachi #amilbabainlahore #amilbabaingujranwalan #amilbabainislamabad
Explore the innovative world of trenchless pipe repair with our comprehensive guide, "The Benefits and Techniques of Trenchless Pipe Repair." This document delves into the modern methods of repairing underground pipes without the need for extensive excavation, highlighting the numerous advantages and the latest techniques used in the industry.
Learn about the cost savings, reduced environmental impact, and minimal disruption associated with trenchless technology. Discover detailed explanations of popular techniques such as pipe bursting, cured-in-place pipe (CIPP) lining, and directional drilling. Understand how these methods can be applied to various types of infrastructure, from residential plumbing to large-scale municipal systems.
Ideal for homeowners, contractors, engineers, and anyone interested in modern plumbing solutions, this guide provides valuable insights into why trenchless pipe repair is becoming the preferred choice for pipe rehabilitation. Stay informed about the latest advancements and best practices in the field.
Overview of the fundamental roles in Hydropower generation and the components involved in wider Electrical Engineering.
This paper presents the design and construction of hydroelectric dams from the hydrologist’s survey of the valley before construction, all aspects and involved disciplines, fluid dynamics, structural engineering, generation and mains frequency regulation to the very transmission of power through the network in the United Kingdom.
Author: Robbie Edward Sayers
Collaborators and co editors: Charlie Sims and Connor Healey.
(C) 2024 Robbie E. Sayers
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdffxintegritypublishin
Advancements in technology unveil a myriad of electrical and electronic breakthroughs geared towards efficiently harnessing limited resources to meet human energy demands. The optimization of hybrid solar PV panels and pumped hydro energy supply systems plays a pivotal role in utilizing natural resources effectively. This initiative not only benefits humanity but also fosters environmental sustainability. The study investigated the design optimization of these hybrid systems, focusing on understanding solar radiation patterns, identifying geographical influences on solar radiation, formulating a mathematical model for system optimization, and determining the optimal configuration of PV panels and pumped hydro storage. Through a comparative analysis approach and eight weeks of data collection, the study addressed key research questions related to solar radiation patterns and optimal system design. The findings highlighted regions with heightened solar radiation levels, showcasing substantial potential for power generation and emphasizing the system's efficiency. Optimizing system design significantly boosted power generation, promoted renewable energy utilization, and enhanced energy storage capacity. The study underscored the benefits of optimizing hybrid solar PV panels and pumped hydro energy supply systems for sustainable energy usage. Optimizing the design of solar PV panels and pumped hydro energy supply systems as examined across diverse climatic conditions in a developing country, not only enhances power generation but also improves the integration of renewable energy sources and boosts energy storage capacities, particularly beneficial for less economically prosperous regions. Additionally, the study provides valuable insights for advancing energy research in economically viable areas. Recommendations included conducting site-specific assessments, utilizing advanced modeling tools, implementing regular maintenance protocols, and enhancing communication among system components.
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)MdTanvirMahtab2
This presentation is about the working procedure of Shahjalal Fertilizer Company Limited (SFCL). A Govt. owned Company of Bangladesh Chemical Industries Corporation under Ministry of Industries.
Cosmetic shop management system project report.pdfKamal Acharya
Buying new cosmetic products is difficult. It can even be scary for those who have sensitive skin and are prone to skin trouble. The information needed to alleviate this problem is on the back of each product, but it's thought to interpret those ingredient lists unless you have a background in chemistry.
Instead of buying and hoping for the best, we can use data science to help us predict which products may be good fits for us. It includes various function programs to do the above mentioned tasks.
Data file handling has been effectively used in the program.
The automated cosmetic shop management system should deal with the automation of general workflow and administration process of the shop. The main processes of the system focus on customer's request where the system is able to search the most appropriate products and deliver it to the customers. It should help the employees to quickly identify the list of cosmetic product that have reached the minimum quantity and also keep a track of expired date for each cosmetic product. It should help the employees to find the rack number in which the product is placed.It is also Faster and more efficient way.
Welcome to WIPAC Monthly the magazine brought to you by the LinkedIn Group Water Industry Process Automation & Control.
In this month's edition, along with this month's industry news to celebrate the 13 years since the group was created we have articles including
A case study of the used of Advanced Process Control at the Wastewater Treatment works at Lleida in Spain
A look back on an article on smart wastewater networks in order to see how the industry has measured up in the interim around the adoption of Digital Transformation in the Water Industry.
A study on the efficiency of a test analysis method utilizing test-categories based on AUT and fault knowledge
1. A Study on the Efficiency of a Test
Analysis Method Utilizing Test-Categories
Based on AUT and Fault Knowledge.
15th Aug. 2014
ICACTCM’2014
Tsuyoshi Yumoto, Keiji Uetsuki, Tohru Matsuodani,
Kazuhiko Tsuda
2. Agenda
1. INTRODUCTION
2. VARIABILITY OF TEST ANALYSIS RESULTS
3. AN APPROACH OF TEST CATEGORIES BASED TESTING
4. REMARKS FROM THE VERIFICATION EXPERIMENT
5. CONCLUSION
2
3. 1. Introduction
Along with a rapid increase in the size and complexity of software
today, the number of required test cases is also increasing.
3
Testing
Development
・Requirement
・Specification
・Design
・Code Development
・Requirement
・Specification
・Design
・Code
increase in size
increase complexity
Testing
10 times
for 30 years
Quantity
FP Test cases
Quantity
FP Test cases
Test cases is equals the FP(function
point) sum to the power of 1.3 to 1.5
(by Capers Jones
4. 2. VARIABILITY OF TEST ANALYSIS RESULTS
Generally, a significant number of testers should be assigned to a project in
order to manage this increase of test cases.
Therefore, there are no clearly defined general rules for test development
process (see next page).
• They are developed according to the individual’s own judgment.
• This has the potential to cause the lacking or duplication of test cases.
Test analysis results when rules are not defined and interpretation is left to the individual
4
5. 2. VARIABILITY OF TEST ANALYSIS RESULTS(Cont.)
Definition of Test development process and Test analysis
• Testing performed at each level depicted in the V model has a process similar to
the development process, and three activities, test analysis, test design, and
test implementation in the test process are called Test development process.
5
A part of V-model
Test analysis
An activity of selecting
and organizing items to be
covered by the test .
6. 3. AN APPROACH OF TEST CATEGORIES BASED TESTING
A set of rules for a test analysis method for black box testing utilizing Test-
Categories based on the Application Under Test (AUT) and fault knowledge
have been proposed.
Overview of the method
The logical structure of a feature
Test –Category
The procedure and document format
6
7. 3. AN APPROACH OF TEST CATEGORIES BASED TESTING
The logical structure of a feature
• It can be used to test the feature in a MECE way . Each box in the logical
structure can be a useful guide to determine the required test conditions.
7
Logical Structure… a MECE way to find test conditions from features.
8. 3. AN APPROACH OF TEST CATEGORIES BASED TESTING
Test-Category
• In order to have a consistent interpretation of determining test conditions, a
8
name specialized for the AUT is put in each box of the logical structure.
• In order to ensure for clearly understanding the meaning of Test-Category ,
potential failures and/or faults which may arise for Test-Category are
discussed.
Knowledge of AUT
Knowledge of faults
experienced in the past
Building consensus
on the decided
Test-Categories
9. 3. AN APPROACH OF TEST CATEGORIES BASED TESTING
The procedure and document format
• Things used to determine test conditions
from a test basis are defined.
9
The outputs are eliminated by layering elements
based on the test case structure.
10. 3. AN APPROACH OF TEST CATEGORIES BASED TESTING
(Cont.)
The Main benefit of this method
• Higher test coverage overall, delivering higher quality testing
– By implementing the set of rules it will be easier to determine the necessary
10
test conditions.
Our hypothesis
The following issues currently make determining the necessary test conditions difficult:
1. Certain aspects of specification are not written if they are thought to be obvious.
2. Specification is not completely written within single target section in a document. (for
example: a behavior about a combination of functions)
– When many testers are involved in test development and proceed according to
the procedure and document format, all of the testers can carry out their work
according to the same set of rules.
The developed suite of test conditions are more
comprehensive and do not contain duplicates
11. 3. AN APPROACH OF TEST CATEGORIES BASED TESTING
(Cont.)
Another benefits of this method
• High Readability
– The procedure is based on the structure of the test conditions defined in the proposal of
11
this method . Elements which are included in the test basis are classified into
specification-items, expected results, and test parameters. One-by-one, these are
determined and selected through this procedure. Thus, the end result readability is
improved.
• Variation in the interpretation is minimized
– Once a consensus regarding the building of Test-Categories is met, team members can
more easily determine and select specification-items.
• Repeatable
– Since this method is structured, standardized and easy to walk though, testers will come
up with consistent and repeatable test analysis.
12. 4. REMARKS FROM THE VERIFICATION EXPERIMENT
The verification experiment Overview
Explain about
Test category
12
Results of the exercise conducted
Feature to be
tested
according to Test-Categories
Test
categories
Spec items Expected
results
Test Basis
Test
Parameters
Feature to be
tested
Spec Item Expected
results
Test
Parameters
Results
were
classified
to test
categories
Results of the exercise conducted
according to Test-Categories
1st exercise
2nd exercise
Comparison and Evaluation for Spec items
B - A A+
13. 4. REMARKS FROM THE VERIFICATION EXPERIMENT
(Cont.)
Evaluation results of the verification experiment
• Eight comparison results table were taken from the two verification experiments.
• There was a measurable improvement resulting from implementing the Test-
Categories method for seven out of eight teams.
• However, there was no indication as to exactly which categories received the
greatest benefit from implementing the method.
Music reproduction equipment Flight Booking Application
13
Logical Team
Structure
Logical
Structure
Team
TM1 TM2 TM3 TM4 TM5 TM6 TM1 TM2
Conv B A B B B B Conv A A
Input Input A B
Output - - - - - A+ Output A A
Storage - A+ - A+ A+ - Storage A A
Support B B B B B B Support B A
Mngt B A A A+ A A+ Mngt B A
14. 4. REMARKS FROM THE VERIFICATION EXPERIMENT
(Cont.)
Evaluation using patterns of input and output data of AUT
• In order to classify and evaluate the results of the verification experiments, patterns of
inputting and outputting data into/from the AUT (I/O data patterns) is focused as a
comprehensive AUT model.
The total combined patterns of
inputting and outputting data
into/from the AUT can be
summarized into the nine patterns
14
15. 4. REMARKS FROM THE VERIFICATION EXPERIMENT
(Cont.)
Evaluation results by I/O data patterns
Music reproduction equipment Flight Booking Application
15
Logical Team Logical
Team
Structure
Structure
TM1 TM2 TM3 TM4 TM5 TM6 TM1 TM2
Conv P1 - - - - - - Input P1 B B
Conv P1 B A+ B B B - Support P1 - A+
Support P1 B B B B B B Support P1 B B
Mngt P1 B A+ A+ A+ A+ A+ Storage P2 A+ A+
Storage P2 - A+ - A+ A+ - Input P4 - -
Conv P4 B B B B - B Mngt P4 B A
Mngt P4 B B B A+ B A+ Output P4 B B
Output P7 - - - - - A+ Output P4 A A
Input P7 A -
Conv P7 A A
Output P7 B B
Summarizing results in the I/O data pattern
P2 is 100% for both the
experiments. It can be said
that P2 has had the most
significant result.
There were no detailed
description about all spec items
for P2 in the test basis.
These results may suggest that
the results are aligned with our
assumption in Section 3.
Music reproduction equipment Flight Application
Evaluation level I/O Evaluation level
pattern
A+ A - B A+ A - B
I/O
pattern
P1 6 0 7 11 35.3% P1 1 0 1 4 20.0%
P2 3 0 3 0 100.0% P2 2 0 0 0 100.0%
P4 2 0 1 9 18.2% P4 0 3 2 3 50.0%
P7 1 0 5 0 100.0% P7 0 3 1 2 60.0%
the persentage = (A+ + A) /(A+ + A + B)
16. Conclusion
• Through these verification experiments it has been observed that after briefly
16
explaining this proposed method to participants there was a measurable
improvement in quantity and consistency of spec-item which they were able to
determine.
• Moreover, by analyzing I/O data patterns, the patterns of inputting and outputting
data into/from the AUT, a part of the evaluation results from the verification
experiments aligned with the assumption in the proposed method.
• Further verification experiments are necessary in order to carry out trend analysis
with higher accuracy.
• Conducting further experiments and deepening our understanding of the
tendencies and factors relating to effectiveness of the proposed method, rules for
creating Test-Categories based on the AUT knowledge and fault knowledge can be
more refined.
18. References
[1] C.Jones,"Estimating Software Costs 2nd Edition": McGraw-Hill, 2007.
[2] D.Longstreet, "Productivity of Software from 1970 to Present",
http://www.softwaremetrics.com/Articles/history.htm, 2000
[3] C.Ebert, and C.Jones. "Embedded Software: Facts, Figures, and Future." IEEE Computer
42.4 ,2009, pp 42-52.
[4] N.Owada"System integration 'straightforward way'",Nikkei Business Publications,
Inc,2009 (In Japanese).
[5] S. Eldh, H.Hansson, and S.Punnekkat, “Analysis of mistakes as a method to improve
test case design.” In Software Testing, Verification and Validation (ICST), 2011 IEEE Fourth
International Conference on.IEEE,2011,pp. 70-79
[6] T.Yumoto, T.Matsuodani, and K.Tsuda. "A Test Analysis Method for Black Box Testing
Using AUT and Fault Knowledge.": Procedia Computer Science 22 ,2013, pp.551-560.
[7] ISTQB FLWG, "Foundation Level Syllabus Version 2011": International Software Testing
Qualifications Board , 2011.
[8] T.J.Ostrand, and M.J.Balcer, "The category-partition method for specifying and
generating fuctional tests.":Communications of the ACM 31.6 ,1988,pp. 676-686.
[9] M.Grindal, and J.Offutt, "Input parameter modeling for combination strategies.":
IASTED International Conference on Software Engineering (SE 2007), 2007.
[10] G.J.Myers, C.Sandler, and T.Badgett, "The art of software testing ": Wiley, 2011.
18
19. References (cont.)
[11] B.Beizer, "Software testing techniques ": Dreamtech Press, 2003.
[12] Y.Nishi, "Viewpoint-based Test Architecture Design.": Software Security and Reliability
Companion (SERE-C), 2012 IEEE Sixth International Conference on. IEEE (2012), pp.194-
197.
[13] K.Akiyama, T.Takagi, and Z.Furukawa, "Development and Evaluation of HAYST Method
Tool (Software Testing)." : SoMeT. ,2010, pp.398-414
[14] S.Omura, "Phenomenology of general system": gohodoshoppan, 2005 (In Japanese).
[15] "IEEE standard for software test documentation ": IEEE829. 2002,2002
[16] Rasiel, E. M. The McKinsey Way. McGraw-Hill; 1999.
[17] Tsuyoshi Yumoto,Tohru Matsuodani,Kazuhiko Tsuda. "A practical Using Method for
Efficent Design of Functionai Testing": 75th National Convention of IPSJ; 2013 , paper#5B-4
(In Japanese).
[18] J.A.Whittaker, "How to break software ": Addison Wesley, 2003.
19
Editor's Notes
8月15日 11時15分~11時30分 12分、質問2分 12枚1分づつ
Good morning everyone. My name is Tsuyoshi Yumoto.
Today, I am going to talk about [A Study on the Efficiency of a Test Analysis Method that I have proposed. ]
This is an agenda of this presentation.
First of all, I will explain the background in section 1 and 2.
In short, I will talk about testing is the big challenge for software development
Actually, to solve these issues, I have proposed a method of Test Analysis Based on Test Categories. So, I will talk about what is test categories and how to use it in section 3
And then, this is the main topic of this paper, I will introduce remarks from the verification experiments for confirming the efficiency of this test analysis method.
This slide, I will tell you the situation of software development today. As I wrote in this slide, a set of test cases that required for software development is really increasing.
Actually, there is a survey that test cases is equals the function point sum to the power of 1.3 to 1.5.
That is why, the increase and complexity of software gives big impact to the quantity of test cases, and a significant number of testers should be assigned to a project in order to manage this increase of test cases.
Although the majority of testers are involved in the test development activity , we can see many software development projects that there are no clearly defined general rules for test development.
In these cases, testers are developed test cases according to the individual’s own judgment. This has the potential to cause the lacking or duplication of test cases.
By the way, I would like to tell you a definition of test development process and test analysis
Normally, testing has a process similar to the development process.
In the testing process, the test planning is performed in parallel with the activities on left side of the V model.
Then, another activities of test process are performed in chronological(クロノロジカル) order.
In addition, three activities, test analysis, test design, and test implementation in the testing process are also called test development process.
Because these are main activities to derive tests for AUT.
Underlying specifications to test design are artifacts on left side of the V model. These are called test basis.
When performing test development, it is necessary to refine the size of AUT at first.
In test development process, test basis is first input, and after analyzing and refining the test basis, and the determine what we should test. That is called test condition. test condition is going to be output of the activity. This activity is the test analysis.
To help solving this issue, I have proposed a set of rules for a test analysis method for black box testing utilizing Test-Categories based on the Application Under Test (AUT) and fault knowledge.
An overview of this test analysis method can be summarize three points.
One is, it is used the logical structure of a feature for determine test conditions. This is a reference model to see a feature in a MECE way . Each box in the logical structure can be a useful guide to determine required test conditions
Two is test category.
In order to have a consistent interpretation of determining test conditions using the logical structure as a guide, a name specialized for the AUT is put in each box of the logical structure of a feature. This is a test category.
And there is an activity in the procedure that potential failures and/or faults which may arise for Test-Category are discussed for building consensus among the testers of the project.
Three is, it is defined the procedure and document formats for test analysis activity.
We assume 2 changes by implementing the set of rules from the method. One is that it will be easier to determine the necessary test conditions. Two is that
all of the testers can carry out their work according to the same set of rules.
As a result, the developed suite of test conditions are more comprehensive and do not contain duplicates. This ensures higher test coverage overall, delivering higher quality testing. This is the main benefit of this method.
There are also another benefits to use this method.
One is High Readability. Two is minimized variation in the interpretation for test analyzing. three is improving to the repeatable process.
Every benefits are good for a project that has a lot of testers .
We have done two verification experiments to know the efficiency of test-category-based testing.
This is the exercise overview in the verification experiment.
We have got 8 comparison results from the two verification experiments. And there was a measurable improvement from implementation the test category method for seven out of eight teams.
But, there was no indication as to exactly which categories received the greatest benefit from implementing the test category method.
So, in order to classify and evaluate the results of the verification experiments as another way, We try to focus patterns of inputting and outputting data into/from the AUT as a comprehensive AUT model.
Because testing is the activity to do input data to AUT and get output data from AUT. It can be describe testing itself.
From this way , it is safe to sum up a few points.
P2 of patterns of inputting and outputting data into/from the AUT is 100% improving for both the experiments. It can be said that P2 has had the most significant result.
And there were no detailed description about all spec items for P2 in the test basis. These results may suggest that the results are aligned with our assumption in Section 3.
So, I would like to conclude this presentation.
We can observe a measurable improvement through the verification experiments. Besides this, the patterns of inputting and outputting data into or from the AUT, a part of the evaluation results from the verification experiments aligned with the assumption in the method that I proposed.
I think conducting further experiments and deepening our understanding of the tendencies and factors relating to effectiveness of the proposed method,
rules for creating Test-Categories can be more refined.
This is the end of my presentation.
Thank you very much.
This is the end of my presentation.
Thank you very much.
This is the end of my presentation.
Thank you very much.