The document discusses various ways that inspections can be used. It describes Niels Malotaux as an expert in helping projects and organizations improve performance through techniques like inspections. Inspections involve reviewing documents like requirements, designs, and test plans to identify defects early when prevention is cheaper. Examples are provided of how inspections were used to successfully improve requirements quality and reduce defects in test plans.
New Model Testing: A New Test Process and ToolTEST Huddle
In this webinar, Paul described his experiences of building and using a bot for paired testing and also propose a new test process suitable for both high integrity and agile environments. His bot – codenamed System Surveyor – builds a model of the system as you explore and captures test ideas, risks and questions and generates structured test documentation as a by-product.
New Model Testing: A New Test Process and ToolTEST Huddle
In this webinar, Paul described his experiences of building and using a bot for paired testing and also propose a new test process suitable for both high integrity and agile environments. His bot – codenamed System Surveyor – builds a model of the system as you explore and captures test ideas, risks and questions and generates structured test documentation as a by-product.
Growing a Company Test Community: Roles and Paths for TestersTEST Huddle
Over the past three years, our company’s test team has grown from three lonesome testers to a community of nine – with more planned. Since we don’t see testers as “click monkeys”, but as valuable and integrated project members who bring a specific skill set to the table, it’s important for us to choose testers well and to train them in various areas so that they can contribute, grow and see their own career path within testing.
To structure to our internal tester training program, we have been developing role descriptions, education paths and career options for our testers, which I’d like to share with you in this webinar.
View webinar - https://huddle.eurostarsoftwaretesting.com/resource/webinar/growing-company-test-community-roles-paths-testers/
I believe that our existing models of testing are not fit for purpose – they are inconsistent, controversial, partial, proprietary and stuck in the past. They are not going to support us in the rapidly emerging technologies and approaches. The certification schemes that should represent the interests and integrity of our profession don’t, and we are left with schemes that are popular, but have low value, lower esteem and attract harsh criticism. My goal in proposing the New Model is to stimulate new thinking in this area.
eurostarconferences.com
testhuddle.com
In this webinar, Dave Haeffner (Elemental Selenium, USA) discusses how to:
- Build an integrated feedback loop to automate test runs and find issues fast
- Setup your own infrastructure or connect to a cloud provider
-Dramatically improve test times with parallelization
https://huddle.eurostarsoftwaretesting.com/resource/webinar/use-selenium-successfully/
You want to integrate skilled testing and development work. But how do you accomplish this without developers accidentally subverting the testing process or testers becoming an obstruction? Efficient, deep testing requires “critical distance” from the development process, commitment and planning to build a testable product, dedication to uncovering the truth, responsiveness among team members, and often a skill set that developers alone—or testers alone—do not ordinarily possess. James Bach presents a model—a redesign of the famous Agile Testing Quadrants that distinguished between business vs. technical facing tests and supporting vs. critiquing―that frames these dynamics and helps teams think through the nature of development and testing roles and how they might blend, conflict, or support each other on an Agile project. James includes a brief discussion of the original Agile Testing Quadrants model, which the presenters believe has created much confusion about the role of testing in Agile.
Exploratory Testing Basics, Experiences, and Future in SSTC2016Kari Kakkonen
Some basics of exploratory testing coupled with experiences, hints and tools for exploratory testing, and wrapped up by a view to the future of exploratory testing. Presentation given 19.10.2016 in Soeul, South Korea in SSTC and TMMi international conference 2016.
Ho Chi Minh City Software Testing Conference January 2015
Software Testing in the Agile World
Website: www.hcmc-stc.org
Author: Lee Copeland
Over the years writers have defined testing as a process of finding, a process of evaluating, a process of measuring, a process of improving. For a quarter of a century we as testers have been focused on the internal process of testing, while generally disregarding its real purpose. The real purpose of testing is to create information. James Bach nailed it when he wrote, “The ultimate reason testers exist is to provide information that others on the project use to create things of value.” That is why testing exists — to provide information of value. So, when managers complain that testing “costs too much” perhaps they are really trying to say, “I’m not getting enough valuable information to justify the cost of testing.” When testers say “my management doesn’t see the value in our work” perhaps they are really trying to say, “My management doesn’t value the information I’m providing to them.” To prove our worth, to increase the value of testing, we must first focus on testing’s purpose — providing valuable information — not its process. Join Lee as he discusses why quantifying the value of testing is difficult work — perhaps that’s why we concentrate so much on testing process—that’s much easier. But until we do this difficult work, until we prove our worth through quantifying our contribution, we should expect the bombardments to continue.
Ho Chi Minh City Software Testing Conference January 2015
Software Testing in the Agile World
Website: www.hcmc-stc.org
Author: Nhat Do, Vu Duong
Context-Driven Testing (CDT) rejects the notion of generalized “best practices” that apply to all projects, and instead accepts that different practices work best under different circumstances. The third principle of the seven defined in CDT states that people are the most important part of any project’s context. Less of a focus on processes and tools, with more emphasis on people and their collaboration empowers testers with the freedom to make choices about how best to do their job without following a restrictive plan.
In joining the game of workshop and some theory sharing in slides, you will a better understanding of Context-Driven Testing practices, principles and its benefits as well as know how is a nice Marriage of Agile and Context-Driven Testing.
dbg Agile Testing Presentation, demonstrating the use of Test Charters, Exploratory Testing, Session Based Testing and Testing Tours. With thanks to James Bach, Lisa Crispin, Janet Gregory and James Whittaker
This talk suggests how we might make sense of the tools landscape of the near future, where the pressure to modernise processes and automate is greatest, and what a new test process supported by tools might look like.
Takeaways:
- We need to take machine learning in testing seriously, but it won’t be taking our jobs just yet
- We don’t need more test automation tools; today we need tools that capture tester knowledge
- Tools that that learn and think can’t work for testers until we solve the knowledge capture challenge.
View On-Demand Webinar: https://youtu.be/EzyUdJFuzlE
Niels Malotaux - Help We Have a QA Problem!TEST Huddle
EuroSTAR Software Testing Conference 2009 presentation on Help We Have a QA Problem! by Niels Malotaux. See more at conferences.eurostarsoftwaretesting.com/past-presentations/
Michael Bolton - Heuristics: Solving Problems RapidlyTEST Huddle
EuroSTAR Software Testing Conference 2008 presentation on Heuristics: Solving Problems Rapidly by Michael Bolton. See more at conferences.eurostarsoftwaretesting.com/past-presentations/
My talk at #TestConVilnius 19.10.2017 about what is exploratory testing (ET), how can you make it work and what is there in the future of exploratory testing: test management tool support, testing with tools, AI support, ET as standard way of testing in especially agile and DevOps projects
Digital Transformation, Testing and AutomationTEST Huddle
The Digital Transformation is real. It is having a profound effect on how business is done and the nature of the systems required to deliver productive customer experiences and consequent business benefits.
Key Takeaways:
- What is the Digital Transformation and how does it affect testing?
- Some key findings from a recent and an ancient survey
- How to achieve testing and automation success.
To view the webinar, visit - http://testhuddle.com/resource/digital-transformation-testing-and-automation/
In this webinar, Hans goes through a number of solutions a team can do to diminish this problem, and what actions to take when it happens. Hans discussed the following solutions on how one can apply better test design to drive better automation, a number of technical strategies, what developers and product owners can do to help, and how to handle the testing and automation work that is still left after a sprint has finished. A key item in handling the test automation work that is left over is that QA’s need to own the testing from the beginning, and should not get stuck in the work of previous sprints, since that will inhibit good cooperation with other team members, making matters worse.
Key Takeaways:
- Get more tests created and automated.
- Make automation manageable and maintainable.
- Keep the QA people in sync with their fellow team members.
View webinar recording - https://testhuddle.com/resource/how-to-get-automated-testing-done/
Growing a Company Test Community: Roles and Paths for TestersTEST Huddle
Over the past three years, our company’s test team has grown from three lonesome testers to a community of nine – with more planned. Since we don’t see testers as “click monkeys”, but as valuable and integrated project members who bring a specific skill set to the table, it’s important for us to choose testers well and to train them in various areas so that they can contribute, grow and see their own career path within testing.
To structure to our internal tester training program, we have been developing role descriptions, education paths and career options for our testers, which I’d like to share with you in this webinar.
View webinar - https://huddle.eurostarsoftwaretesting.com/resource/webinar/growing-company-test-community-roles-paths-testers/
I believe that our existing models of testing are not fit for purpose – they are inconsistent, controversial, partial, proprietary and stuck in the past. They are not going to support us in the rapidly emerging technologies and approaches. The certification schemes that should represent the interests and integrity of our profession don’t, and we are left with schemes that are popular, but have low value, lower esteem and attract harsh criticism. My goal in proposing the New Model is to stimulate new thinking in this area.
eurostarconferences.com
testhuddle.com
In this webinar, Dave Haeffner (Elemental Selenium, USA) discusses how to:
- Build an integrated feedback loop to automate test runs and find issues fast
- Setup your own infrastructure or connect to a cloud provider
-Dramatically improve test times with parallelization
https://huddle.eurostarsoftwaretesting.com/resource/webinar/use-selenium-successfully/
You want to integrate skilled testing and development work. But how do you accomplish this without developers accidentally subverting the testing process or testers becoming an obstruction? Efficient, deep testing requires “critical distance” from the development process, commitment and planning to build a testable product, dedication to uncovering the truth, responsiveness among team members, and often a skill set that developers alone—or testers alone—do not ordinarily possess. James Bach presents a model—a redesign of the famous Agile Testing Quadrants that distinguished between business vs. technical facing tests and supporting vs. critiquing―that frames these dynamics and helps teams think through the nature of development and testing roles and how they might blend, conflict, or support each other on an Agile project. James includes a brief discussion of the original Agile Testing Quadrants model, which the presenters believe has created much confusion about the role of testing in Agile.
Exploratory Testing Basics, Experiences, and Future in SSTC2016Kari Kakkonen
Some basics of exploratory testing coupled with experiences, hints and tools for exploratory testing, and wrapped up by a view to the future of exploratory testing. Presentation given 19.10.2016 in Soeul, South Korea in SSTC and TMMi international conference 2016.
Ho Chi Minh City Software Testing Conference January 2015
Software Testing in the Agile World
Website: www.hcmc-stc.org
Author: Lee Copeland
Over the years writers have defined testing as a process of finding, a process of evaluating, a process of measuring, a process of improving. For a quarter of a century we as testers have been focused on the internal process of testing, while generally disregarding its real purpose. The real purpose of testing is to create information. James Bach nailed it when he wrote, “The ultimate reason testers exist is to provide information that others on the project use to create things of value.” That is why testing exists — to provide information of value. So, when managers complain that testing “costs too much” perhaps they are really trying to say, “I’m not getting enough valuable information to justify the cost of testing.” When testers say “my management doesn’t see the value in our work” perhaps they are really trying to say, “My management doesn’t value the information I’m providing to them.” To prove our worth, to increase the value of testing, we must first focus on testing’s purpose — providing valuable information — not its process. Join Lee as he discusses why quantifying the value of testing is difficult work — perhaps that’s why we concentrate so much on testing process—that’s much easier. But until we do this difficult work, until we prove our worth through quantifying our contribution, we should expect the bombardments to continue.
Ho Chi Minh City Software Testing Conference January 2015
Software Testing in the Agile World
Website: www.hcmc-stc.org
Author: Nhat Do, Vu Duong
Context-Driven Testing (CDT) rejects the notion of generalized “best practices” that apply to all projects, and instead accepts that different practices work best under different circumstances. The third principle of the seven defined in CDT states that people are the most important part of any project’s context. Less of a focus on processes and tools, with more emphasis on people and their collaboration empowers testers with the freedom to make choices about how best to do their job without following a restrictive plan.
In joining the game of workshop and some theory sharing in slides, you will a better understanding of Context-Driven Testing practices, principles and its benefits as well as know how is a nice Marriage of Agile and Context-Driven Testing.
dbg Agile Testing Presentation, demonstrating the use of Test Charters, Exploratory Testing, Session Based Testing and Testing Tours. With thanks to James Bach, Lisa Crispin, Janet Gregory and James Whittaker
This talk suggests how we might make sense of the tools landscape of the near future, where the pressure to modernise processes and automate is greatest, and what a new test process supported by tools might look like.
Takeaways:
- We need to take machine learning in testing seriously, but it won’t be taking our jobs just yet
- We don’t need more test automation tools; today we need tools that capture tester knowledge
- Tools that that learn and think can’t work for testers until we solve the knowledge capture challenge.
View On-Demand Webinar: https://youtu.be/EzyUdJFuzlE
Niels Malotaux - Help We Have a QA Problem!TEST Huddle
EuroSTAR Software Testing Conference 2009 presentation on Help We Have a QA Problem! by Niels Malotaux. See more at conferences.eurostarsoftwaretesting.com/past-presentations/
Michael Bolton - Heuristics: Solving Problems RapidlyTEST Huddle
EuroSTAR Software Testing Conference 2008 presentation on Heuristics: Solving Problems Rapidly by Michael Bolton. See more at conferences.eurostarsoftwaretesting.com/past-presentations/
My talk at #TestConVilnius 19.10.2017 about what is exploratory testing (ET), how can you make it work and what is there in the future of exploratory testing: test management tool support, testing with tools, AI support, ET as standard way of testing in especially agile and DevOps projects
Digital Transformation, Testing and AutomationTEST Huddle
The Digital Transformation is real. It is having a profound effect on how business is done and the nature of the systems required to deliver productive customer experiences and consequent business benefits.
Key Takeaways:
- What is the Digital Transformation and how does it affect testing?
- Some key findings from a recent and an ancient survey
- How to achieve testing and automation success.
To view the webinar, visit - http://testhuddle.com/resource/digital-transformation-testing-and-automation/
In this webinar, Hans goes through a number of solutions a team can do to diminish this problem, and what actions to take when it happens. Hans discussed the following solutions on how one can apply better test design to drive better automation, a number of technical strategies, what developers and product owners can do to help, and how to handle the testing and automation work that is still left after a sprint has finished. A key item in handling the test automation work that is left over is that QA’s need to own the testing from the beginning, and should not get stuck in the work of previous sprints, since that will inhibit good cooperation with other team members, making matters worse.
Key Takeaways:
- Get more tests created and automated.
- Make automation manageable and maintainable.
- Keep the QA people in sync with their fellow team members.
View webinar recording - https://testhuddle.com/resource/how-to-get-automated-testing-done/
In this advanced business analysis training session, you will learn User Stories from Scenarios. Topics covered in this session are:
• What is a Use Case?
• The Purpose of Use Case Analysis
• Managing the Building of Product
• The Basic Development Loop
• Analysis paralysis – how much is enough
• Conceptual model development
• Style Guide development
• Usability testing during agile increments
For more information, click here: https://www.mindsmapped.com/courses/business-analysis/advanced-business-analyst-training/
DataOps is the transformation of data processing from a craft with manual processes to an automated data factory. Lean principles, which have proven successful in manufacturing, are equally applicable for data factories. We will describe how lean principles can be applied in practice for successful data processing.
Nowadays in IT market, most of enterprises are trying to adopt agile and DevOps methodology to meet the time-to-market expectations and continue satisfying their customers. As the result, continue deploying new applications are become challenges for any software development teams.
During the development cycles, several questions has been identified and one of the most interesting questions is How to fit automated tests into agile projects because within agile sprints, there is simply not enough time to automate the set of tests?
Action Based Testing (ABT) methodology is becoming a solution to help you achieve your expectations on automated test coverage within the Agile iterations/sprints.
ABT uses a modular keyword-driven approach which tests are organized in test modules and are built up of sequences of actions. Well-defined test modules can provide a healthy framework for teams to work with, in particular if modules have a clear and unambiguous scope, the scope is well-differentiated from other test modules, and all test cases …within the test module reflect the scope.
A key differentiation is between business tests and interaction tests. Business tests have a business-oriented scope and should not contain UI details. Interaction tests focus on the interaction between the user (or another system) and the application.
This topic is about how to apply ABT methodologies into SDLC with some discussions on the three Holy Grail of test design approaches from Hans Buwalda.
In IT software, clients wants to know when they will be delivered. Discover how to secure your Delivery roadmap, defining your Release cycles with Agile iterations.
My Experiments In Agile Testing in Yahoo.pptxBaiju Joseph
During my last 10+ years of agile testing journey we have tried out few experiments and innovations. Some of them worked really well and some of them failed. Some of the experiments which yielded good results are in the areas of test automation infrastructure, Test Huddles, thinning the developer-tester boundary, usage of mind maps, theme based group tests etc...Usage of A/B testing also yielded good results in some of the projects.
What a DevOps specialist has to know about static code analysisAndrey Karpov
Reasons of failed introductions.
Place of static analysis in the DevOps process.
Static analysis – friend or foe.
Notifications about analysis results.
What to do with 10 000 analyzer warnings after the first run?
How much time is needed for fixing all bugs?
Q&A or what’s next?
How to Make a Field invisible in Odoo 17Celine George
It is possible to hide or invisible some fields in odoo. Commonly using “invisible” attribute in the field definition to invisible the fields. This slide will show how to make a field invisible in odoo 17.
Operation “Blue Star” is the only event in the history of Independent India where the state went into war with its own people. Even after about 40 years it is not clear if it was culmination of states anger over people of the region, a political game of power or start of dictatorial chapter in the democratic setup.
The people of Punjab felt alienated from main stream due to denial of their just demands during a long democratic struggle since independence. As it happen all over the word, it led to militant struggle with great loss of lives of military, police and civilian personnel. Killing of Indira Gandhi and massacre of innocent Sikhs in Delhi and other India cities was also associated with this movement.
Acetabularia Information For Class 9 .docxvaibhavrinwa19
Acetabularia acetabulum is a single-celled green alga that in its vegetative state is morphologically differentiated into a basal rhizoid and an axially elongated stalk, which bears whorls of branching hairs. The single diploid nucleus resides in the rhizoid.
2024.06.01 Introducing a competency framework for languag learning materials ...Sandy Millin
http://sandymillin.wordpress.com/iateflwebinar2024
Published classroom materials form the basis of syllabuses, drive teacher professional development, and have a potentially huge influence on learners, teachers and education systems. All teachers also create their own materials, whether a few sentences on a blackboard, a highly-structured fully-realised online course, or anything in between. Despite this, the knowledge and skills needed to create effective language learning materials are rarely part of teacher training, and are mostly learnt by trial and error.
Knowledge and skills frameworks, generally called competency frameworks, for ELT teachers, trainers and managers have existed for a few years now. However, until I created one for my MA dissertation, there wasn’t one drawing together what we need to know and do to be able to effectively produce language learning materials.
This webinar will introduce you to my framework, highlighting the key competencies I identified from my research. It will also show how anybody involved in language teaching (any language, not just English!), teacher training, managing schools or developing language learning materials can benefit from using the framework.
Model Attribute Check Company Auto PropertyCeline George
In Odoo, the multi-company feature allows you to manage multiple companies within a single Odoo database instance. Each company can have its own configurations while still sharing common resources such as products, customers, and suppliers.
A Strategic Approach: GenAI in EducationPeter Windle
Artificial Intelligence (AI) technologies such as Generative AI, Image Generators and Large Language Models have had a dramatic impact on teaching, learning and assessment over the past 18 months. The most immediate threat AI posed was to Academic Integrity with Higher Education Institutes (HEIs) focusing their efforts on combating the use of GenAI in assessment. Guidelines were developed for staff and students, policies put in place too. Innovative educators have forged paths in the use of Generative AI for teaching, learning and assessments leading to pockets of transformation springing up across HEIs, often with little or no top-down guidance, support or direction.
This Gasta posits a strategic approach to integrating AI into HEIs to prepare staff, students and the curriculum for an evolving world and workplace. We will highlight the advantages of working with these technologies beyond the realm of teaching, learning and assessment by considering prompt engineering skills, industry impact, curriculum changes, and the need for staff upskilling. In contrast, not engaging strategically with Generative AI poses risks, including falling behind peers, missed opportunities and failing to ensure our graduates remain employable. The rapid evolution of AI technologies necessitates a proactive and strategic approach if we are to remain relevant.
Macroeconomics- Movie Location
This will be used as part of your Personal Professional Portfolio once graded.
Objective:
Prepare a presentation or a paper using research, basic comparative analysis, data organization and application of economic information. You will make an informed assessment of an economic climate outside of the United States to accomplish an entertainment industry objective.
Honest Reviews of Tim Han LMA Course Program.pptxtimhan337
Personal development courses are widely available today, with each one promising life-changing outcomes. Tim Han’s Life Mastery Achievers (LMA) Course has drawn a lot of interest. In addition to offering my frank assessment of Success Insider’s LMA Course, this piece examines the course’s effects via a variety of Tim Han LMA course reviews and Success Insider comments.
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...Levi Shapiro
Letter from the Congress of the United States regarding Anti-Semitism sent June 3rd to MIT President Sally Kornbluth, MIT Corp Chair, Mark Gorenberg
Dear Dr. Kornbluth and Mr. Gorenberg,
The US House of Representatives is deeply concerned by ongoing and pervasive acts of antisemitic
harassment and intimidation at the Massachusetts Institute of Technology (MIT). Failing to act decisively to ensure a safe learning environment for all students would be a grave dereliction of your responsibilities as President of MIT and Chair of the MIT Corporation.
This Congress will not stand idly by and allow an environment hostile to Jewish students to persist. The House believes that your institution is in violation of Title VI of the Civil Rights Act, and the inability or
unwillingness to rectify this violation through action requires accountability.
Postsecondary education is a unique opportunity for students to learn and have their ideas and beliefs challenged. However, universities receiving hundreds of millions of federal funds annually have denied
students that opportunity and have been hijacked to become venues for the promotion of terrorism, antisemitic harassment and intimidation, unlawful encampments, and in some cases, assaults and riots.
The House of Representatives will not countenance the use of federal funds to indoctrinate students into hateful, antisemitic, anti-American supporters of terrorism. Investigations into campus antisemitism by the Committee on Education and the Workforce and the Committee on Ways and Means have been expanded into a Congress-wide probe across all relevant jurisdictions to address this national crisis. The undersigned Committees will conduct oversight into the use of federal funds at MIT and its learning environment under authorities granted to each Committee.
• The Committee on Education and the Workforce has been investigating your institution since December 7, 2023. The Committee has broad jurisdiction over postsecondary education, including its compliance with Title VI of the Civil Rights Act, campus safety concerns over disruptions to the learning environment, and the awarding of federal student aid under the Higher Education Act.
• The Committee on Oversight and Accountability is investigating the sources of funding and other support flowing to groups espousing pro-Hamas propaganda and engaged in antisemitic harassment and intimidation of students. The Committee on Oversight and Accountability is the principal oversight committee of the US House of Representatives and has broad authority to investigate “any matter” at “any time” under House Rule X.
• The Committee on Ways and Means has been investigating several universities since November 15, 2023, when the Committee held a hearing entitled From Ivory Towers to Dark Corners: Investigating the Nexus Between Antisemitism, Tax-Exempt Universities, and Terror Financing. The Committee followed the hearing with letters to those institutions on January 10, 202
June 3, 2024 Anti-Semitism Letter Sent to MIT President Kornbluth and MIT Cor...
Inspection used in various ways
1. 1Malotaux – InspectionVariousWays – SQAdays Minsk Nov 2016
Niels Malotaux
+31-655 753 604 niels@malotaux.eu www.malotaux.eu
Inspection
used in various ways
www.malotaux.eu/conferences
www.malotaux.eu/booklets
www.malotaux.eu/inspections
2. 2Malotaux – InspectionVariousWays – SQAdays Minsk Nov 2016
Niels Malotaux
• Independent Project and Organizational Coach
• Expert in helping optimizing performance
• Helping projects and organizations very quickly to become
• More effective – doing the right things better
• More efficient – doing the right things better in less time
• Predictable – delivering as predicted
• Getting projects on track
3. 3Malotaux – InspectionVariousWays – SQAdays Minsk Nov 2016
Quality On Time
The most effective way of improving software
productivity and shortening project schedules is to
reduce defect levels
Capers Jones
• Both Quality and On Time is improved if we work on
reducing defect levels
• Why are testers so obsessed to find defects, where we
should have no defects
5. 5Malotaux – InspectionVariousWays – SQAdays Minsk Nov 2016
We are people
Prevention costs much less than inject find (?) repair (?)
People make
mistakes
We are people
Repair of problems
costs exponentially
more if found later
If we do something,
we introduce problems
So, when to solve
these problems?
Immediately after
making the mistake.
So, when to solve
these problems?
Immediately after
making the mistake,
or preferably:
by preventing mistakes
When to solve
these problems?
6. 6Malotaux – InspectionVariousWays – SQAdays Minsk Nov 2016
Dijkstra (1972)
It is a usual technique to make a program and then to test it
However:
Program testing can be a very effective way to show
the presence of defects
but it is hopelessly inadequate for showing their absence
Conventional testing:
• Pursuing the very effective way to show the presence of defects
The challenge is, however:
• Making sure that there are no defects (development)
• How to show their absence if they’re not there (testing ?)
7. 7Malotaux – InspectionVariousWays – SQAdays Minsk Nov 2016
Concept: DesignLog
• In computer, not loose notes, not in e-mails, not handwritten
• Text
• Drawings!
• Chapter per subject
• Initially free-format
• For all to see
• All concepts contemplated
• Requirement
• Reasoning
• Assumptions
• Questions
• Calculations
• Possible solutions
• Selection criteria
• Choices:
• If rejected: why?
• If chosen: why?
• Implementation specification
Chapter
Requirement What to achieve
.
Reasoning
Assumptions
Questions + Answers
Calculations
.
..
..
.
Possible solutions
Selection criteria
Decision How to achieve
New date: change of idea:
Repeat some of the above
Decision How to achieve
Design Log
8. 8Malotaux – InspectionVariousWays – SQAdays Minsk Nov 2016
Chapter
Requirement What to achieve
.
Reasoning
Assumptions
Questions + Answers
Calculations
.
..
..
.
Possible solutions
Selection criteria
Decision How to achieve
New date: change of idea:
Repeat some of the above
Decision How to achieve
Design Log
Case: In the pub
James:
Niels, this is Louise
Louise, this is Niels, who taught me about
DesignLogging - Tell what happened
Louise:
• We had only 7 days to finish some software
• We were working hard, coding, testing, coding, testing
• James said we should stop coding and go back to the design
• "We don't have time !" - "We've only 7 days !"
• James insisted
• We designed, found the problem, corrected it, cleaned up the mess
• Done in less than 7 days
• Thank you!
9. 9Malotaux – InspectionVariousWays – SQAdays Minsk Nov 2016
What James told me later
• I gave the design to two colleagues for review
• Louise corrected some minor issues
• It went into a ‘final’ review, with another colleague
• Based in his expertise,
the solution was completely reworked
• Actually, two features were delivered and deployed
• One that was design and code reviewed had no issues after
deployment
• Other one, was the source of quite some defects
• From now on we use DesignLogs, to be reviewed
before coding
10. 10Malotaux – InspectionVariousWays – SQAdays Minsk Nov 2016
Iterate as needed
Design techniques
• Design
• Review
• Code
• Review
• Test (no questions, no issues)
• If issue in test: no Band-Aid: start all over again:
Review: What’s wrong with the design ?
• If there is no design: Reconstruct the design !
• QA to review the DesignLog for more efficiently helping the
developers: Ask "Can we see the DesignLog ?"
Chapter
Requirement What to achieve
.
Reasoning
Assumptions
Questions + Answers
Calculations
.
..
..
.
Possible solutions
Selection criteria
Decision How to achieve
New date: change of idea:
Repeat some of the above
Decision How to achieve
Design Log
11. 11Malotaux – InspectionVariousWays – SQAdays Minsk Nov 2016
Case: Can you teach Inspections ?
• Short intro
• Are you regularly reviewing ?
• Let’s do it: baseline
• Take a document
• Reproduce one page
• Do review
• No issues
• One rule (‘source’)
• Many issues
13. 13Malotaux – InspectionVariousWays – SQAdays Minsk Nov 2016
Results
• No code until design-log is reviewed
• You’re delaying my project !
• Example
• Solution
• Thanks, you saved my project
• Now we can review to check the design before
implementation
• Did I do the same ?
• Telling people to change: resistance
• How to let people change themselves …
Chapter
Requirement What to achieve
.
Assumptions
Questions + Answers
.
.
.
.
Design options
Decision criteria
Decision implementation spec
(how to achieve)
New date: change of idea:
Repeat some of the above
Decision implementation spec
Design Log
14. 14Malotaux – InspectionVariousWays – SQAdays Minsk Nov 2016
From the DesignLog
A number of Firmware based methods of removing the
glitches from the datalog reading process have been
investigated,
but it has been decided to go with a mechanism
implemented in the external system reading the datalog
to remove the glitches.
15. 15Malotaux – InspectionVariousWays – SQAdays Minsk Nov 2016
Case: City of Amsterdam
• Can you teach Inspections ?
• You’ll ditch the document after the course !
• Ha ha
• Of course they did
16. 16Malotaux – InspectionVariousWays – SQAdays Minsk Nov 2016
Early Inspection
Prevention costs less than Repair
Completeness
0%
(Rev 0.1)
100%
(Rev 1.0)
Initial
Review
Additional Reviews
(Author’s Discretion)
Formal
Inspection
…
50%
ES
17. 17Malotaux – InspectionVariousWays – SQAdays Minsk Nov 2016
Case: Early Inspection on Requirements
Large e-business application with 8 requirements authors
• Each sent the first 8-10 requirements
of ~100 requirements per author
(table format, about 2 requirements per page including all data)
• Initial reviews completed within a few hours of submission
• Authors integrated the suggestions and corrections,
then continued to work
• Some authors chose additional reviews, others did not
• Inspection performed on document to assess
final quality level
ES
18. 18Malotaux – InspectionVariousWays – SQAdays Minsk Nov 2016
Results
Time investment: 26 hr
• 12 hours in initial review (1.5 hrs per author)
• About 8 hours in additional reviews
• 6 hours in final inspection (2 hrs, 2 checkers, plus prep and debrief)
Major defects prevented: 5 per requirement in ~750 total
Saved 5 x 750 x 10 hr = 37500 hr / 3 = 12500 x $50 = $625000
Average major defects per requirement in initial review 8
Average major defects per requirement in final document 3
ES
19. 19Malotaux – InspectionVariousWays – SQAdays Minsk Nov 2016
Early Inspection
Prevention costs less than Repair
Completeness
0%
(Rev 0.1)
100%
(Rev 1.0)
Initial
Review
Additional Reviews
(Author’s Discretion)
Formal
Inspection
…
50%
ES
20. 20Malotaux – InspectionVariousWays – SQAdays Minsk Nov 2016
Case: Test Cases
A tester’s improvement writing successive test plans
• Early Inspection used on an existing project to improve
test plan quality
• Test plan nearly “complete”, so we simulated Early Inspection
• First round: inspected 6 randomly-selected test cases
• Author notes systematic defects in the results,
reworks the document accordingly (~32 hrs)
• Second round: inspected 6 more test cases:
quality vastly improved
• Test plan exits the process and goes into production
• The author goes on to write another test plan
ES
21. 21Malotaux – InspectionVariousWays – SQAdays Minsk Nov 2016
Results
• Time investment: 2 hours in initial review, 36 hours total
in final formal inspection, excluding rework
(2 inspections, 4 hrs each, 4 checkers, plus preparation and debrief)
• Historically about 25% of all defects found by testing were closed as
“functions as designed”, still 2-4 hrs spent on each to find out
• This test plan yielded over 1100 software defects with only
1 defect (0.1 %) closed as “functions as designed”
• Time saved on the project: 500 - 1000 hrs (25% x 1100 x 2-4 hrs )
Defect Prevention in action: First inspection of this tester’s
next test plan: 0.2 major defects per test case
First round 6 major defects per test case
Second round 0.5 major defects per test case
ES
22. 22Malotaux – InspectionVariousWays – SQAdays Minsk Nov 2016
Optimum Checking Rate
• The most effective individual speed for ‘checking a
document against all related documents’ in page/hr
• Not ‘reading’ speed, but rather correlation speed
• Failure to use it, gives ‘bad estimate’ for ‘Remaining
defects’
• 100~250 SLoC per hour
• 1 page of 300 words per hour (“logical page”)
TG
24. 24Malotaux – InspectionVariousWays – SQAdays Minsk Nov 2016
Typical Review
• Find some defects, one Major
• Fix them
• Consider the document now corrected and OK ...
major minor
minor
DG
Ref. Dorothy Graham
25. 25Malotaux – InspectionVariousWays – SQAdays Minsk Nov 2016
Taking a sample
• Inspection can find deep-seated defects
• All of that type can be corrected
• Needs optimum checking rate
• In the above case we are clearly taking a sample
• In the “shallow” case we were also taking a sample,
however, we didn’t feel it !
Ref. Dorothy Graham
DG
26. 26Malotaux – InspectionVariousWays – SQAdays Minsk Nov 2016
Niels Malotaux
+31-655 753 604 niels@malotaux.eu www.malotaux.eu
Inspection
used in various ways
www.malotaux.eu/conferences
www.malotaux.eu/booklets
www.malotaux.eu/inspections