SlideShare a Scribd company logo
1 of 7
INTRODUCING A TOOL INTO
AN ORGANIZATION
By Graham et.al (2011)
http://sif.uin-suska.ac.id/
http://fst.uin-suska.ac.id/
http://www.uin-suska.ac.id/
UNIVERSITAS ISLAM NEGERI
SULTAN SYARIF KASIM
RIAU
MUHAMMAD BRANIKNO R
The place to start when introducing a tool into an organization is
not with the tool - it is with the organization. In order for a tool
to provide benefit, it must match a need within the organization,
and solve that need in a way that is both effective and efficient.
The tool should help to build on the strengths of the
organization and address its weaknesses. The organization needs
to be ready for the changes that will come with the new tool. If
the current testing practices are not good and the organization is
not mature, then it is generally more cost- effective to improve
testing practices rather than to try to find tools to support poor
practices. Automating chaos just gives faster chaos!
Main principles
1
Of course, we can sometimes improve our own processes in
parallel with introducing a tool to support those practices and we can pick
up some good ideas for improvement from the ways that the tools work.
However, be aware that the tool should not take the lead, but should
provide support to what your organization defines.
The following factors are important in selecting a tool:
• assessment of the organization's maturity (e.g. readiness for change);
• identification of the areas within the organization where tool support
will help to improve testing processes;
• evaluation of tools against clear requirements and objective criteria;
• proof-of-concept to see whether the product works as desired and
meets the requirements and objectives defined for it;
• evaluation of the vendor (training, support and other commercial
aspects) or open-source network of support;
• identifying and planning internal implementation (including coaching
and mentoring for those new to the use of the tool).
Cont…
One of the ways to do a proof-of-concept is to have a pilot
project as the first thing done with a new tool. This will use the tool in
earnest but on a small scale, with sufficient time to explore different
ways of using the tool. Objectives should be set for the pilot in order to
assess whether or not the concept is proven, i.e. that the tool can
accomplish what is needed within the current organizational context.
A pilot tool project should expect to encounter problems -
they should be solved in ways that can be used by everyone later on.
The pilot project should experiment with different ways of using the
tool. For example, different settings for a static analysis tool, different
reports from a test management tool, differ- ent scripting and
comparison techniques for a test execution tool or different load
profiles for a performance-testing tool.
Pilot project
2
The objectives for a pilot project for a new tool are:
• to learn more about the tool (more detail, more depth);
• to see how the tool would fit with existing processes or
documentation, how those would need to change to work
well with the tool and how to use the tool to streamline
existing processes;
• to decide on standard ways of using the tool that will work for
all potential users (e.g. naming conventions, creation of
libraries, defining modularity, where different elements will
be stored, how they and the tool itself will be maintained);
• to evaluate the pilot project against its objectives (have the
benefits been achieved at reasonable cost?).
Cont…
Success is not guaranteed or automatic when implementing a
testing tool, but many organizations have succeeded. Here are some of
the factors that have contributed to success:
• incremental roll-out (after the pilot) to the rest of the organization;
• adapting and improving processes, testware and tool artefacts to
get the best fit and balance between them and the use of the tool;
• providing adequate training, coaching and mentoring of new users;
• defining and communicating guidelines for the use of the tool,
based on what was learned in the pilot;
• implementing a continuous improvement mechanism as tool use
spreads through more of the organization;
• monitoring the use of the tool and the benefits achieved and
adapting the use of the tool to take account of what is learned.
More information and advice about selecting and implementing tools
can be found in [Fewster and Graham, 1999] and [Dustin et al., 1999].
Success factors
3
Introducing a tool into an organization

More Related Content

What's hot

Introducing a Tool Into an Organization
Introducing a Tool Into an OrganizationIntroducing a Tool Into an Organization
Introducing a Tool Into an OrganizationRakhesLeoPutra
 
3 . introducing a tool into an organization
3 . introducing a tool into an organization3 . introducing a tool into an organization
3 . introducing a tool into an organizationsabrian SIF
 
Introducing a tool into an organization
Introducing a tool into an organizationIntroducing a tool into an organization
Introducing a tool into an organizationAji Pamungkas Prasetio
 
JD Unit Manager
JD Unit ManagerJD Unit Manager
JD Unit ManagerAmol More
 
Resesarch on SQA
Resesarch on SQAResesarch on SQA
Resesarch on SQAAisha Khan
 
Notes on Evaluation of eLearning
Notes on Evaluation of eLearningNotes on Evaluation of eLearning
Notes on Evaluation of eLearningMichael M Grant
 
Capturing requirements and delivering change to a cinical
Capturing requirements and delivering change to a cinicalCapturing requirements and delivering change to a cinical
Capturing requirements and delivering change to a cinicalAdam Heatherington
 
Graham et.al, 2008, Foundations of Software Testing ISTQB Certification. Chap...
Graham et.al, 2008, Foundations of Software Testing ISTQB Certification. Chap...Graham et.al, 2008, Foundations of Software Testing ISTQB Certification. Chap...
Graham et.al, 2008, Foundations of Software Testing ISTQB Certification. Chap...Muhammad Jazman
 
ENRE 642 Reliability Engineering Management course flyer
ENRE 642 Reliability Engineering Management course flyerENRE 642 Reliability Engineering Management course flyer
ENRE 642 Reliability Engineering Management course flyerAccendo Reliability
 
Usability Evaluation in Educational Technology
Usability Evaluation in Educational Technology Usability Evaluation in Educational Technology
Usability Evaluation in Educational Technology Alaa Sadik
 
Does your performance testing tool support correlation capabilities
Does your performance testing tool support correlation capabilitiesDoes your performance testing tool support correlation capabilities
Does your performance testing tool support correlation capabilitiesImpetus Technologies
 
UFE step-by-step: an introduction
UFE step-by-step: an introductionUFE step-by-step: an introduction
UFE step-by-step: an introductionROER4D
 

What's hot (20)

Introducing a Tool Into an Organization
Introducing a Tool Into an OrganizationIntroducing a Tool Into an Organization
Introducing a Tool Into an Organization
 
3 . introducing a tool into an organization
3 . introducing a tool into an organization3 . introducing a tool into an organization
3 . introducing a tool into an organization
 
Introducing a tool into an organization
Introducing a tool into an organizationIntroducing a tool into an organization
Introducing a tool into an organization
 
JD Unit Manager
JD Unit ManagerJD Unit Manager
JD Unit Manager
 
Marjuni
MarjuniMarjuni
Marjuni
 
Online testing strategy
Online testing strategyOnline testing strategy
Online testing strategy
 
Evaluation of eLearning
Evaluation of eLearningEvaluation of eLearning
Evaluation of eLearning
 
Designing for performance
Designing for performanceDesigning for performance
Designing for performance
 
Resesarch on SQA
Resesarch on SQAResesarch on SQA
Resesarch on SQA
 
Notes on Evaluation of eLearning
Notes on Evaluation of eLearningNotes on Evaluation of eLearning
Notes on Evaluation of eLearning
 
Capturing requirements and delivering change to a cinical
Capturing requirements and delivering change to a cinicalCapturing requirements and delivering change to a cinical
Capturing requirements and delivering change to a cinical
 
Best Practices Activity
Best Practices ActivityBest Practices Activity
Best Practices Activity
 
Cqaf vet larissa ali presentation
Cqaf vet larissa ali presentationCqaf vet larissa ali presentation
Cqaf vet larissa ali presentation
 
ENRE642 Summer 2014 flyer
ENRE642 Summer 2014 flyerENRE642 Summer 2014 flyer
ENRE642 Summer 2014 flyer
 
Graham et.al, 2008, Foundations of Software Testing ISTQB Certification. Chap...
Graham et.al, 2008, Foundations of Software Testing ISTQB Certification. Chap...Graham et.al, 2008, Foundations of Software Testing ISTQB Certification. Chap...
Graham et.al, 2008, Foundations of Software Testing ISTQB Certification. Chap...
 
ENRE 642 Reliability Engineering Management course flyer
ENRE 642 Reliability Engineering Management course flyerENRE 642 Reliability Engineering Management course flyer
ENRE 642 Reliability Engineering Management course flyer
 
Usability Evaluation in Educational Technology
Usability Evaluation in Educational Technology Usability Evaluation in Educational Technology
Usability Evaluation in Educational Technology
 
Benchmarking
Benchmarking Benchmarking
Benchmarking
 
Does your performance testing tool support correlation capabilities
Does your performance testing tool support correlation capabilitiesDoes your performance testing tool support correlation capabilities
Does your performance testing tool support correlation capabilities
 
UFE step-by-step: an introduction
UFE step-by-step: an introductionUFE step-by-step: an introduction
UFE step-by-step: an introduction
 

Similar to Introducing a tool into an organization

Introducing a tool into an organization
Introducing a tool into an organizationIntroducing a tool into an organization
Introducing a tool into an organizationIrvan Febry
 
Tool support for testing
Tool support for testingTool support for testing
Tool support for testingromi wisarta
 
Chapter 6 - Test Tools and Automation
Chapter 6 - Test Tools and AutomationChapter 6 - Test Tools and Automation
Chapter 6 - Test Tools and AutomationNeeraj Kumar Singh
 
Chapter 6 Tool Support for Testing
Chapter 6 Tool Support for TestingChapter 6 Tool Support for Testing
Chapter 6 Tool Support for TestingZetryan Satria
 
The AAA Test Transformation Model
The AAA Test Transformation ModelThe AAA Test Transformation Model
The AAA Test Transformation ModelSushant Hublikar
 
228 Chapter 8 • Measurementto collect more validation data mor.docx
228   Chapter 8 • Measurementto collect more validation data mor.docx228   Chapter 8 • Measurementto collect more validation data mor.docx
228 Chapter 8 • Measurementto collect more validation data mor.docxeugeniadean34240
 
Testing management (testing management)
Testing management (testing management)Testing management (testing management)
Testing management (testing management)helfa safitri
 
Discover Capabilities In Your Organisation
Discover Capabilities In Your OrganisationDiscover Capabilities In Your Organisation
Discover Capabilities In Your OrganisationAcorn
 
tool support for testing
tool support for testingtool support for testing
tool support for testingaidil fitra
 
Automated software testing
Automated software testingAutomated software testing
Automated software testinggauravpanwar8
 
Test management nopri wahyudi
Test management nopri wahyudiTest management nopri wahyudi
Test management nopri wahyudiNopriwahyudi
 
Tool Support For Testing
Tool Support For TestingTool Support For Testing
Tool Support For TestingJeri Handika
 
Effective Talent Management Strategy: Assessing Needs and Aspirations
Effective Talent Management Strategy: Assessing Needs and AspirationsEffective Talent Management Strategy: Assessing Needs and Aspirations
Effective Talent Management Strategy: Assessing Needs and AspirationsWowledge
 
38475471 qa-and-software-testing-interview-questions-and-answers
38475471 qa-and-software-testing-interview-questions-and-answers38475471 qa-and-software-testing-interview-questions-and-answers
38475471 qa-and-software-testing-interview-questions-and-answersMaria FutureThoughts
 
Software quality management tools
Software quality management toolsSoftware quality management tools
Software quality management toolsselinasimpson361
 
Some steps and rules to deploy dynamics ax
Some steps and rules to deploy dynamics axSome steps and rules to deploy dynamics ax
Some steps and rules to deploy dynamics axGuy de Lussigny
 
Fundamental of testing (Test Management)
Fundamental of testing (Test Management)Fundamental of testing (Test Management)
Fundamental of testing (Test Management)CindyYuristie
 

Similar to Introducing a tool into an organization (20)

Introducing a tool into an organization
Introducing a tool into an organizationIntroducing a tool into an organization
Introducing a tool into an organization
 
Tool Support For Testing
Tool Support For TestingTool Support For Testing
Tool Support For Testing
 
Tool support for testing
Tool support for testingTool support for testing
Tool support for testing
 
Tool support for testing
Tool support for testingTool support for testing
Tool support for testing
 
Chapter 6 - Test Tools and Automation
Chapter 6 - Test Tools and AutomationChapter 6 - Test Tools and Automation
Chapter 6 - Test Tools and Automation
 
Chapter 6 Tool Support for Testing
Chapter 6 Tool Support for TestingChapter 6 Tool Support for Testing
Chapter 6 Tool Support for Testing
 
The AAA Test Transformation Model
The AAA Test Transformation ModelThe AAA Test Transformation Model
The AAA Test Transformation Model
 
Tool support for testing
Tool support for testingTool support for testing
Tool support for testing
 
228 Chapter 8 • Measurementto collect more validation data mor.docx
228   Chapter 8 • Measurementto collect more validation data mor.docx228   Chapter 8 • Measurementto collect more validation data mor.docx
228 Chapter 8 • Measurementto collect more validation data mor.docx
 
Testing management (testing management)
Testing management (testing management)Testing management (testing management)
Testing management (testing management)
 
Discover Capabilities In Your Organisation
Discover Capabilities In Your OrganisationDiscover Capabilities In Your Organisation
Discover Capabilities In Your Organisation
 
tool support for testing
tool support for testingtool support for testing
tool support for testing
 
Automated software testing
Automated software testingAutomated software testing
Automated software testing
 
Test management nopri wahyudi
Test management nopri wahyudiTest management nopri wahyudi
Test management nopri wahyudi
 
Tool Support For Testing
Tool Support For TestingTool Support For Testing
Tool Support For Testing
 
Effective Talent Management Strategy: Assessing Needs and Aspirations
Effective Talent Management Strategy: Assessing Needs and AspirationsEffective Talent Management Strategy: Assessing Needs and Aspirations
Effective Talent Management Strategy: Assessing Needs and Aspirations
 
38475471 qa-and-software-testing-interview-questions-and-answers
38475471 qa-and-software-testing-interview-questions-and-answers38475471 qa-and-software-testing-interview-questions-and-answers
38475471 qa-and-software-testing-interview-questions-and-answers
 
Software quality management tools
Software quality management toolsSoftware quality management tools
Software quality management tools
 
Some steps and rules to deploy dynamics ax
Some steps and rules to deploy dynamics axSome steps and rules to deploy dynamics ax
Some steps and rules to deploy dynamics ax
 
Fundamental of testing (Test Management)
Fundamental of testing (Test Management)Fundamental of testing (Test Management)
Fundamental of testing (Test Management)
 

More from M Branikno Ramadhan

Specification based or black box techniques
Specification based or black box techniquesSpecification based or black box techniques
Specification based or black box techniquesM Branikno Ramadhan
 
Specification based or black box techniques
Specification based or black box techniquesSpecification based or black box techniques
Specification based or black box techniquesM Branikno Ramadhan
 
Tutorial membuat pki menggunakan thunderbird
Tutorial membuat pki menggunakan thunderbirdTutorial membuat pki menggunakan thunderbird
Tutorial membuat pki menggunakan thunderbirdM Branikno Ramadhan
 

More from M Branikno Ramadhan (6)

Specification based or black box techniques
Specification based or black box techniquesSpecification based or black box techniques
Specification based or black box techniques
 
Fundamental test process
Fundamental test processFundamental test process
Fundamental test process
 
Specification based or black box techniques
Specification based or black box techniquesSpecification based or black box techniques
Specification based or black box techniques
 
Fundamental test process
Fundamental test processFundamental test process
Fundamental test process
 
Ssl(secure socket layer)
Ssl(secure socket layer)Ssl(secure socket layer)
Ssl(secure socket layer)
 
Tutorial membuat pki menggunakan thunderbird
Tutorial membuat pki menggunakan thunderbirdTutorial membuat pki menggunakan thunderbird
Tutorial membuat pki menggunakan thunderbird
 

Recently uploaded

Solving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxSolving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxOH TEIK BIN
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxpboyjonauth
 
Final demo Grade 9 for demo Plan dessert.pptx
Final demo Grade 9 for demo Plan dessert.pptxFinal demo Grade 9 for demo Plan dessert.pptx
Final demo Grade 9 for demo Plan dessert.pptxAvyJaneVismanos
 
What is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPWhat is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPCeline George
 
Types of Journalistic Writing Grade 8.pptx
Types of Journalistic Writing Grade 8.pptxTypes of Journalistic Writing Grade 8.pptx
Types of Journalistic Writing Grade 8.pptxEyham Joco
 
Painted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of IndiaPainted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of IndiaVirag Sontakke
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatYousafMalik24
 
CELL CYCLE Division Science 8 quarter IV.pptx
CELL CYCLE Division Science 8 quarter IV.pptxCELL CYCLE Division Science 8 quarter IV.pptx
CELL CYCLE Division Science 8 quarter IV.pptxJiesonDelaCerna
 
Full Stack Web Development Course for Beginners
Full Stack Web Development Course  for BeginnersFull Stack Web Development Course  for Beginners
Full Stack Web Development Course for BeginnersSabitha Banu
 
Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17Celine George
 
MARGINALIZATION (Different learners in Marginalized Group
MARGINALIZATION (Different learners in Marginalized GroupMARGINALIZATION (Different learners in Marginalized Group
MARGINALIZATION (Different learners in Marginalized GroupJonathanParaisoCruz
 
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdfFraming an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdfUjwalaBharambe
 
Roles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceRoles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceSamikshaHamane
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentInMediaRes1
 
Hierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementHierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementmkooblal
 

Recently uploaded (20)

Solving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxSolving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptx
 
9953330565 Low Rate Call Girls In Rohini Delhi NCR
9953330565 Low Rate Call Girls In Rohini  Delhi NCR9953330565 Low Rate Call Girls In Rohini  Delhi NCR
9953330565 Low Rate Call Girls In Rohini Delhi NCR
 
Introduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptxIntroduction to AI in Higher Education_draft.pptx
Introduction to AI in Higher Education_draft.pptx
 
ESSENTIAL of (CS/IT/IS) class 06 (database)
ESSENTIAL of (CS/IT/IS) class 06 (database)ESSENTIAL of (CS/IT/IS) class 06 (database)
ESSENTIAL of (CS/IT/IS) class 06 (database)
 
Final demo Grade 9 for demo Plan dessert.pptx
Final demo Grade 9 for demo Plan dessert.pptxFinal demo Grade 9 for demo Plan dessert.pptx
Final demo Grade 9 for demo Plan dessert.pptx
 
What is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPWhat is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERP
 
Types of Journalistic Writing Grade 8.pptx
Types of Journalistic Writing Grade 8.pptxTypes of Journalistic Writing Grade 8.pptx
Types of Journalistic Writing Grade 8.pptx
 
Painted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of IndiaPainted Grey Ware.pptx, PGW Culture of India
Painted Grey Ware.pptx, PGW Culture of India
 
Earth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice greatEarth Day Presentation wow hello nice great
Earth Day Presentation wow hello nice great
 
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
 
CELL CYCLE Division Science 8 quarter IV.pptx
CELL CYCLE Division Science 8 quarter IV.pptxCELL CYCLE Division Science 8 quarter IV.pptx
CELL CYCLE Division Science 8 quarter IV.pptx
 
Full Stack Web Development Course for Beginners
Full Stack Web Development Course  for BeginnersFull Stack Web Development Course  for Beginners
Full Stack Web Development Course for Beginners
 
Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17
 
MARGINALIZATION (Different learners in Marginalized Group
MARGINALIZATION (Different learners in Marginalized GroupMARGINALIZATION (Different learners in Marginalized Group
MARGINALIZATION (Different learners in Marginalized Group
 
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdfFraming an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
Framing an Appropriate Research Question 6b9b26d93da94caf993c038d9efcdedb.pdf
 
Roles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in PharmacovigilanceRoles & Responsibilities in Pharmacovigilance
Roles & Responsibilities in Pharmacovigilance
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media Component
 
Hierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of managementHierarchy of management that covers different levels of management
Hierarchy of management that covers different levels of management
 
OS-operating systems- ch04 (Threads) ...
OS-operating systems- ch04 (Threads) ...OS-operating systems- ch04 (Threads) ...
OS-operating systems- ch04 (Threads) ...
 
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Bikash Puri  Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Bikash Puri Delhi reach out to us at 🔝9953056974🔝
 

Introducing a tool into an organization

  • 1. INTRODUCING A TOOL INTO AN ORGANIZATION By Graham et.al (2011) http://sif.uin-suska.ac.id/ http://fst.uin-suska.ac.id/ http://www.uin-suska.ac.id/ UNIVERSITAS ISLAM NEGERI SULTAN SYARIF KASIM RIAU MUHAMMAD BRANIKNO R
  • 2. The place to start when introducing a tool into an organization is not with the tool - it is with the organization. In order for a tool to provide benefit, it must match a need within the organization, and solve that need in a way that is both effective and efficient. The tool should help to build on the strengths of the organization and address its weaknesses. The organization needs to be ready for the changes that will come with the new tool. If the current testing practices are not good and the organization is not mature, then it is generally more cost- effective to improve testing practices rather than to try to find tools to support poor practices. Automating chaos just gives faster chaos! Main principles 1
  • 3. Of course, we can sometimes improve our own processes in parallel with introducing a tool to support those practices and we can pick up some good ideas for improvement from the ways that the tools work. However, be aware that the tool should not take the lead, but should provide support to what your organization defines. The following factors are important in selecting a tool: • assessment of the organization's maturity (e.g. readiness for change); • identification of the areas within the organization where tool support will help to improve testing processes; • evaluation of tools against clear requirements and objective criteria; • proof-of-concept to see whether the product works as desired and meets the requirements and objectives defined for it; • evaluation of the vendor (training, support and other commercial aspects) or open-source network of support; • identifying and planning internal implementation (including coaching and mentoring for those new to the use of the tool). Cont…
  • 4. One of the ways to do a proof-of-concept is to have a pilot project as the first thing done with a new tool. This will use the tool in earnest but on a small scale, with sufficient time to explore different ways of using the tool. Objectives should be set for the pilot in order to assess whether or not the concept is proven, i.e. that the tool can accomplish what is needed within the current organizational context. A pilot tool project should expect to encounter problems - they should be solved in ways that can be used by everyone later on. The pilot project should experiment with different ways of using the tool. For example, different settings for a static analysis tool, different reports from a test management tool, differ- ent scripting and comparison techniques for a test execution tool or different load profiles for a performance-testing tool. Pilot project 2
  • 5. The objectives for a pilot project for a new tool are: • to learn more about the tool (more detail, more depth); • to see how the tool would fit with existing processes or documentation, how those would need to change to work well with the tool and how to use the tool to streamline existing processes; • to decide on standard ways of using the tool that will work for all potential users (e.g. naming conventions, creation of libraries, defining modularity, where different elements will be stored, how they and the tool itself will be maintained); • to evaluate the pilot project against its objectives (have the benefits been achieved at reasonable cost?). Cont…
  • 6. Success is not guaranteed or automatic when implementing a testing tool, but many organizations have succeeded. Here are some of the factors that have contributed to success: • incremental roll-out (after the pilot) to the rest of the organization; • adapting and improving processes, testware and tool artefacts to get the best fit and balance between them and the use of the tool; • providing adequate training, coaching and mentoring of new users; • defining and communicating guidelines for the use of the tool, based on what was learned in the pilot; • implementing a continuous improvement mechanism as tool use spreads through more of the organization; • monitoring the use of the tool and the benefits achieved and adapting the use of the tool to take account of what is learned. More information and advice about selecting and implementing tools can be found in [Fewster and Graham, 1999] and [Dustin et al., 1999]. Success factors 3