SlideShare a Scribd company logo
Test Management in TeamForge
By Janardhanam Venkat
CollabNetTeamForgeALMcovers all phases of the life cycle from plan, code, build and test to deploy.
With the recent addition of TestLink, a widely adopted open source product for test management,
TeamForge now has the added capability to create test case trackers and associate them with
requirements. With TeamForge, users have the ability to execute test cases and store test results.
TestLink utilizesatrackerto store test casesand also tie TestPlansintobuild. By integrating TeamForge
with TestLink the test management features are available in TeamForge as part of end-to-end ALM
solution.
The main ideabehind thisintegrationis to associate Test Suite to the TeamForge requirements tracker
epics, stories and tasks. The execution of Test Plan creates defects in TeamForge with associations to
other TeamForge tools and data as shown in the following illustration.
ImplementingEnterprise Agility
TeamForge’s open architecture allows customers to integrate their favorite open source tools,
commercial and home grown tools into the software lifecycle. TestLink leverages the ‘Open ALM
Platform’ nature of TeamForge to provide a seamless, fully packaged and fully supported set of test
capabilities for all users who want to participate in collaborative test management for local and
distributed teams alike. This integration ensures complete traceability of all artifacts in the software
lifecycle from requirements to test plan through test execution and reporting.
TeamForge-TestLink integration results in extended capabilities both at a project level and at a
company-wide community level – i.e., the organizational “Community Architecture”. The TestLink
integration letsmanagersandstakeholders access continuous Test Management reports in TeamForge
project pages. These real time reports bring a consolidated view of the TestLink within TeamForge,
which is seamlessly viewed by the company wide stakeholders who have appropriate permissions. In
addition, the workflow between TeamForge and TestLink can be rolled out to all projects and have a
dramatic impact on improving overall release cycle velocity, software quality and reducing costs.
Integration Details
The TeamForge-TestLink integration is based on CollabNet’s Integrated Application Framework (IAF)
similartohow Review Board was integrated with TeamForge. Using the IAF framework, single sign-on
between TeamForgeand TestLink is managed, with TeamForge project and user creation replicated to
TestLink. In addition, the TestLink permissions are displayed in TeamForge during user creation.
Assumptions
 TestLink hasa requirementmanagementtrackerthat can be linked to multiple bug trackers. As
part of thisintegration, itisassumedthatrequirementsanddefectsare managedinTeamForge.
 The TeamForge-TestLink integrationwascreatedwith multiple use cases gatheredviainterviews
with current and potential customers. Enhancements and feature request will evolve as user
experiences evolve.
Basic Terminology
Here’sa listof some of the basicCollabNetTeamForge-TestLinkterminologies:
 Test Case:A setof inputs,executionpreconditions,andexpectedresults(outcomes) developed
for a particular objective, such as to exercise a particular program path or to verify compliance
with a specific requirement.
 Test Suite: Organizes Test Cases to units and structures Test Specification into logical parts.
 Test Plan: Created to execute Test Cases. Test Plans can be made up of Test Cases from the
current Test Project. Test Plan includes Builds, Milestones, user assignment and Test Results.
 Builds: A specificrelease of software.Each project in an organization is most likely made up of
manyBuilds.If there are no Buildscreatedfora project thenthe execution of test cases will not
allowed.
The above capabilitiesare hierarchical,facilitatingcomplex testcase management. Forinstance,the
TestSuite isa containerthatcan holdmultiple testcases. Testcasescanbe usedinmultiple TestPlans.
The same TestPlancan be executedagainstmultiple builds.
IntegrationFlow
While creatingrequirements inTeamForge userscancreate TestSuitesas a placeholder in TestLink. For
everyrequirement,the usercancreate a TestSuite in TestLink.Later, the user can get into TestLink and
create test cases for the requirements. Once test cases are created, a Test Plan that bundles the test
casesto be executed is created. Test Cases are reused in multiple Test Plans. For example, one would
like to run all tests of a feature ‘A’ that has four test cases in Sprint 1. Later, a test plan, for example
TestPlan1,canbe createdandall the four test cases can be associated to this Test Plan1. The same test
casescan be reusedinTestPlan2asshownabove.Once the Test Plan is established, it can be executed
and the user can update the test result as Pass/Failed/Blocked. For failed test cases a defect is
automatically created in TeamForge defect tracker and association is created between the defect and
the test case to maintain traceability.
IntegrationOut of boxfeatures
TestLink has the following features that can be leveraged by users:
 Import/Export - Test Suites and Test cases can be imported and exported between projects in
XML format.
 Email notification –Notificationabouttestcase assignmentsandtestreports(once the report is
generated in TestLink) can be sent to users via email.
 Assignkeyword tags- Keywords are tagged to a group of test cases and these keywords can be
used to categorize test case groups.
 Customfields –Userscan extendthe mostimportantobjects(Testcases, Testsuites, Testplans)
in TestLink with customized fields.
 Support for Chinese, Japanese & Korean languages.
 Version Test Case – There is an option to version every test case and the user can visually
identify changes between Test Case versions using TestLink.
CollabNetTestLinkIntegrationsto otherTools
The Test Case execution is done manually, wherein users, after testing a case, will manually update
PASS/FAILineachtestcase.There isan optionfor userstouse Seleniumtorunall test cases and update
the TestLink withPASS/FAIL. Seleniumintegrationisavailable for functional testing and there is a JAVA
API to update the test results in TestLink.
Similarly, the Build artifact created in TestLink is a placeholder and the user has to create the build
artifact manually to assign Test Plan to a build. Using TestLink Jenkins plug-in, the build job in Jenkins
will create build artifact automatically in TestLink when a build is successful. In addition, few test
management reports from TestLink will be displayed in TeamForge project page.
Reports & Dashboard
The CollabNetTestLinkintegrationprovides awide arrayof out-of-the-boxreportsthatcan be usedto
generate the following forall permissionedusersinthe TeamForge system
 TestReporton build
• TestCase AssignmentOverview
• Failed,Blocked,NotrunTestCases
• TestCase notassignedto Test Plan
• TestresultMatrix
The CollabNetTestLinkintegrationalsoprovidescharts thatshow executionresultsbyTestSuite and
overall testmetrics.
Additional dashboardsindicate progress byproject:
CustomerMigration Path
The CollabNet customers have two migration paths. The first one is an existing TeamForge customer
who is interested in using TestLink. In this case, a migration script has to be run to synchronize
TeamForge userstoTestLink.Once the usersare migratedto TestLink,the permissiontoaccess TestLink
for migrated users has to be manually created in TeamForge. The following illustration shows the
migration path.
The second migration path (casually called as glue) is for customers who are using TeamForge and
TestLink as two separate systems that are not integrated. In this case there will be bi-directional
migration,inwhich the TeamForge users are migrated to TestLink and the permission for the migrated
usersto accessTestLink are createdmanuallyinTeamForge.The migration also moves selected project
and its users, roles and permissions from TestLink to TeamForge. In addition, it will also auto-migrate
requirementsfromTestLinktoTeamForge andthenassociate the migratedrequirements to Test Cases.
Summary
The CollabNetTeamForge-TestLink integration builds on top of TeamForge’ s capability to support the
software development life cycle from plan, code, build and test to deploy. With TestLink integration,
TeamForge now has the extended capability to create test case trackers and associate them with
requirements andprovide traceabilityand test management right from requirements through release.
Initial user feedback has been encouraging. You can attend my webinar on November 18th
2014 and
signup now.I’dlike to hear what you think and what features you would like to see added. Please let
me know venkatj@collab.net .

More Related Content

What's hot

Testing with test_complete
Testing with test_completeTesting with test_complete
Testing with test_completebinuiweb
 
Module 1: Introduction to .NET Framework 3.5 (Material)
Module 1: Introduction to .NET Framework 3.5 (Material)Module 1: Introduction to .NET Framework 3.5 (Material)
Module 1: Introduction to .NET Framework 3.5 (Material)
Mohamed Saleh
 
Qtp (2)
Qtp (2)Qtp (2)
Qtp (2)
soujanya k
 
Mykola Kovsh - Functional API automation with Jmeter
Mykola Kovsh - Functional API automation with JmeterMykola Kovsh - Functional API automation with Jmeter
Mykola Kovsh - Functional API automation with Jmeter
Ievgenii Katsan
 
Track g semiconductor test program - testinsight
Track g  semiconductor test program - testinsightTrack g  semiconductor test program - testinsight
Track g semiconductor test program - testinsightchiportal
 
Test automation framework
Test automation frameworkTest automation framework
Test automation framework
QACampus
 
Automation testing material by Durgasoft,hyderabad
Automation testing material by Durgasoft,hyderabadAutomation testing material by Durgasoft,hyderabad
Automation testing material by Durgasoft,hyderabad
Durga Prasad
 
MTM Test Management System
MTM Test Management SystemMTM Test Management System
MTM Test Management SystemMinu Mishra
 
Visual Studio 2010 Testing Overview
Visual Studio 2010 Testing OverviewVisual Studio 2010 Testing Overview
Visual Studio 2010 Testing Overview
Steve Lange
 
Automation testing by Durgasoft in Hyderabad
Automation testing by Durgasoft in HyderabadAutomation testing by Durgasoft in Hyderabad
Automation testing by Durgasoft in Hyderabad
Durga Prasad
 
Hrishikesh_iitg_internship_report
Hrishikesh_iitg_internship_reportHrishikesh_iitg_internship_report
Hrishikesh_iitg_internship_reportHrishikesh Malakar
 
Tutorial ranorex
Tutorial ranorexTutorial ranorex
Tutorial ranorexradikalzen
 
EMC Documentum xCP 2.x Tips for application migration v1.1
EMC Documentum xCP 2.x Tips for application migration v1.1EMC Documentum xCP 2.x Tips for application migration v1.1
EMC Documentum xCP 2.x Tips for application migration v1.1
Haytham Ghandour
 
FaSaT An Interoperable Test Automation Solution
FaSaT An Interoperable Test Automation SolutionFaSaT An Interoperable Test Automation Solution
FaSaT An Interoperable Test Automation Solution
QuEST Global (erstwhile NeST Software)
 
QTP&UFT Automation Framework
QTP&UFT Automation FrameworkQTP&UFT Automation Framework
QTP&UFT Automation FrameworkYu Tao Zhang
 
A Test Automation Framework
A Test Automation FrameworkA Test Automation Framework
A Test Automation Framework
Gregory Solovey
 
Automation Testing with TestComplete
Automation Testing with TestCompleteAutomation Testing with TestComplete
Automation Testing with TestComplete
RomSoft SRL
 

What's hot (19)

Testing with test_complete
Testing with test_completeTesting with test_complete
Testing with test_complete
 
Automation Testing Syllabus - Checklist
Automation Testing Syllabus - ChecklistAutomation Testing Syllabus - Checklist
Automation Testing Syllabus - Checklist
 
Module 1: Introduction to .NET Framework 3.5 (Material)
Module 1: Introduction to .NET Framework 3.5 (Material)Module 1: Introduction to .NET Framework 3.5 (Material)
Module 1: Introduction to .NET Framework 3.5 (Material)
 
Qtp (2)
Qtp (2)Qtp (2)
Qtp (2)
 
Mykola Kovsh - Functional API automation with Jmeter
Mykola Kovsh - Functional API automation with JmeterMykola Kovsh - Functional API automation with Jmeter
Mykola Kovsh - Functional API automation with Jmeter
 
Testing in TFS
Testing in TFSTesting in TFS
Testing in TFS
 
Track g semiconductor test program - testinsight
Track g  semiconductor test program - testinsightTrack g  semiconductor test program - testinsight
Track g semiconductor test program - testinsight
 
Test automation framework
Test automation frameworkTest automation framework
Test automation framework
 
Automation testing material by Durgasoft,hyderabad
Automation testing material by Durgasoft,hyderabadAutomation testing material by Durgasoft,hyderabad
Automation testing material by Durgasoft,hyderabad
 
MTM Test Management System
MTM Test Management SystemMTM Test Management System
MTM Test Management System
 
Visual Studio 2010 Testing Overview
Visual Studio 2010 Testing OverviewVisual Studio 2010 Testing Overview
Visual Studio 2010 Testing Overview
 
Automation testing by Durgasoft in Hyderabad
Automation testing by Durgasoft in HyderabadAutomation testing by Durgasoft in Hyderabad
Automation testing by Durgasoft in Hyderabad
 
Hrishikesh_iitg_internship_report
Hrishikesh_iitg_internship_reportHrishikesh_iitg_internship_report
Hrishikesh_iitg_internship_report
 
Tutorial ranorex
Tutorial ranorexTutorial ranorex
Tutorial ranorex
 
EMC Documentum xCP 2.x Tips for application migration v1.1
EMC Documentum xCP 2.x Tips for application migration v1.1EMC Documentum xCP 2.x Tips for application migration v1.1
EMC Documentum xCP 2.x Tips for application migration v1.1
 
FaSaT An Interoperable Test Automation Solution
FaSaT An Interoperable Test Automation SolutionFaSaT An Interoperable Test Automation Solution
FaSaT An Interoperable Test Automation Solution
 
QTP&UFT Automation Framework
QTP&UFT Automation FrameworkQTP&UFT Automation Framework
QTP&UFT Automation Framework
 
A Test Automation Framework
A Test Automation FrameworkA Test Automation Framework
A Test Automation Framework
 
Automation Testing with TestComplete
Automation Testing with TestCompleteAutomation Testing with TestComplete
Automation Testing with TestComplete
 

Similar to Test Management in TeamForge

What is integration testing
What is integration testingWhat is integration testing
What is integration testing
TestingXperts
 
DevOps CI Automation Continuous Integration
DevOps CI Automation Continuous IntegrationDevOps CI Automation Continuous Integration
DevOps CI Automation Continuous Integration
IRJET Journal
 
Unit Testing in Flutter - From Workflow Essentials to Complex Scenarios
Unit Testing in Flutter - From Workflow Essentials to Complex ScenariosUnit Testing in Flutter - From Workflow Essentials to Complex Scenarios
Unit Testing in Flutter - From Workflow Essentials to Complex Scenarios
Flutter Agency
 
Testing Strategies in .NET: From Unit Testing to Integration Testing
Testing Strategies in .NET: From Unit Testing to Integration TestingTesting Strategies in .NET: From Unit Testing to Integration Testing
Testing Strategies in .NET: From Unit Testing to Integration Testing
Tyrion Lannister
 
Scale and Load Testing of Micro-Service
Scale and Load Testing of Micro-ServiceScale and Load Testing of Micro-Service
Scale and Load Testing of Micro-Service
IRJET Journal
 
Getting started with test complete 7
Getting started with test complete 7Getting started with test complete 7
Getting started with test complete 7
Hoamuoigio Hoa
 
qTest <> TestProject Integration Webinar
qTest <> TestProject Integration WebinarqTest <> TestProject Integration Webinar
qTest <> TestProject Integration Webinar
Kevin Dunne
 
Qtp questions and answers
Qtp questions and answersQtp questions and answers
Qtp questions and answersRamu Palanki
 
Getting started with_testcomplete
Getting started with_testcompleteGetting started with_testcomplete
Getting started with_testcompleteankit.das
 
Test driven development and unit testing with examples in C++
Test driven development and unit testing with examples in C++Test driven development and unit testing with examples in C++
Test driven development and unit testing with examples in C++
Hong Le Van
 
hp_alm.docx
hp_alm.docxhp_alm.docx
hp_alm.docx
AkshayK706991
 
ISTQB Agile Tester - Agile Test Tools
ISTQB Agile Tester - Agile Test ToolsISTQB Agile Tester - Agile Test Tools
ISTQB Agile Tester - Agile Test Tools
Moataz Nabil
 
Tools for Software Verification and Validation
Tools for Software Verification and ValidationTools for Software Verification and Validation
Tools for Software Verification and Validationaliraza786
 
Test automation
Test automationTest automation
Test automation
Jitendra Malviya
 
Automated testing of JavaFX GUI components
Automated testing of JavaFX GUI componentsAutomated testing of JavaFX GUI components
Automated testing of JavaFX GUI components
Wolfgang Weigend
 
Test management in Agile Teams
Test management in Agile TeamsTest management in Agile Teams
Test management in Agile Teams
Venkat Janardhanam, MS, MBA
 
Acceptance test driven development
Acceptance test driven developmentAcceptance test driven development
Acceptance test driven developmentEditor Jacotech
 
New features in qtp11
New features in qtp11New features in qtp11
New features in qtp11
G.C Reddy
 
New features in qtp11
New features in qtp11New features in qtp11
New features in qtp11Ramu Palanki
 
Qtp 11 new enhacements in
Qtp 11 new enhacements inQtp 11 new enhacements in
Qtp 11 new enhacements inRamu Palanki
 

Similar to Test Management in TeamForge (20)

What is integration testing
What is integration testingWhat is integration testing
What is integration testing
 
DevOps CI Automation Continuous Integration
DevOps CI Automation Continuous IntegrationDevOps CI Automation Continuous Integration
DevOps CI Automation Continuous Integration
 
Unit Testing in Flutter - From Workflow Essentials to Complex Scenarios
Unit Testing in Flutter - From Workflow Essentials to Complex ScenariosUnit Testing in Flutter - From Workflow Essentials to Complex Scenarios
Unit Testing in Flutter - From Workflow Essentials to Complex Scenarios
 
Testing Strategies in .NET: From Unit Testing to Integration Testing
Testing Strategies in .NET: From Unit Testing to Integration TestingTesting Strategies in .NET: From Unit Testing to Integration Testing
Testing Strategies in .NET: From Unit Testing to Integration Testing
 
Scale and Load Testing of Micro-Service
Scale and Load Testing of Micro-ServiceScale and Load Testing of Micro-Service
Scale and Load Testing of Micro-Service
 
Getting started with test complete 7
Getting started with test complete 7Getting started with test complete 7
Getting started with test complete 7
 
qTest <> TestProject Integration Webinar
qTest <> TestProject Integration WebinarqTest <> TestProject Integration Webinar
qTest <> TestProject Integration Webinar
 
Qtp questions and answers
Qtp questions and answersQtp questions and answers
Qtp questions and answers
 
Getting started with_testcomplete
Getting started with_testcompleteGetting started with_testcomplete
Getting started with_testcomplete
 
Test driven development and unit testing with examples in C++
Test driven development and unit testing with examples in C++Test driven development and unit testing with examples in C++
Test driven development and unit testing with examples in C++
 
hp_alm.docx
hp_alm.docxhp_alm.docx
hp_alm.docx
 
ISTQB Agile Tester - Agile Test Tools
ISTQB Agile Tester - Agile Test ToolsISTQB Agile Tester - Agile Test Tools
ISTQB Agile Tester - Agile Test Tools
 
Tools for Software Verification and Validation
Tools for Software Verification and ValidationTools for Software Verification and Validation
Tools for Software Verification and Validation
 
Test automation
Test automationTest automation
Test automation
 
Automated testing of JavaFX GUI components
Automated testing of JavaFX GUI componentsAutomated testing of JavaFX GUI components
Automated testing of JavaFX GUI components
 
Test management in Agile Teams
Test management in Agile TeamsTest management in Agile Teams
Test management in Agile Teams
 
Acceptance test driven development
Acceptance test driven developmentAcceptance test driven development
Acceptance test driven development
 
New features in qtp11
New features in qtp11New features in qtp11
New features in qtp11
 
New features in qtp11
New features in qtp11New features in qtp11
New features in qtp11
 
Qtp 11 new enhacements in
Qtp 11 new enhacements inQtp 11 new enhacements in
Qtp 11 new enhacements in
 

More from Venkat Janardhanam, MS, MBA

Team forge Test Management with TestLink
Team forge Test Management with TestLinkTeam forge Test Management with TestLink
Team forge Test Management with TestLink
Venkat Janardhanam, MS, MBA
 
India agile week chennai - Agile maturity to scale for enterprise & blendin...
India agile week   chennai - Agile maturity to scale for enterprise & blendin...India agile week   chennai - Agile maturity to scale for enterprise & blendin...
India agile week chennai - Agile maturity to scale for enterprise & blendin...
Venkat Janardhanam, MS, MBA
 
Agile developers do it globally - v5
Agile developers do it globally - v5Agile developers do it globally - v5
Agile developers do it globally - v5
Venkat Janardhanam, MS, MBA
 
Improving Quality through Continuous Integration - A case study of CollabNet
Improving Quality through Continuous Integration - A case study of CollabNetImproving Quality through Continuous Integration - A case study of CollabNet
Improving Quality through Continuous Integration - A case study of CollabNetVenkat Janardhanam, MS, MBA
 
Agile ALM Tool Comparison
Agile ALM Tool ComparisonAgile ALM Tool Comparison
Agile ALM Tool Comparison
Venkat Janardhanam, MS, MBA
 

More from Venkat Janardhanam, MS, MBA (10)

Team forge Test Management with TestLink
Team forge Test Management with TestLinkTeam forge Test Management with TestLink
Team forge Test Management with TestLink
 
India agile week chennai - Agile maturity to scale for enterprise & blendin...
India agile week   chennai - Agile maturity to scale for enterprise & blendin...India agile week   chennai - Agile maturity to scale for enterprise & blendin...
India agile week chennai - Agile maturity to scale for enterprise & blendin...
 
Journey to the center of DevOps - v6
Journey to the center of DevOps - v6Journey to the center of DevOps - v6
Journey to the center of DevOps - v6
 
Agile Adoption in Testing 2013 - v2
Agile Adoption in Testing 2013 - v2Agile Adoption in Testing 2013 - v2
Agile Adoption in Testing 2013 - v2
 
Developer want change Ops want control - devops
Developer want change Ops want control - devopsDeveloper want change Ops want control - devops
Developer want change Ops want control - devops
 
Agile developers do it globally - v5
Agile developers do it globally - v5Agile developers do it globally - v5
Agile developers do it globally - v5
 
Improving Quality through Continuous Integration - A case study of CollabNet
Improving Quality through Continuous Integration - A case study of CollabNetImproving Quality through Continuous Integration - A case study of CollabNet
Improving Quality through Continuous Integration - A case study of CollabNet
 
Agile estimation
Agile estimationAgile estimation
Agile estimation
 
Purpose Of ALM Tool
Purpose Of ALM ToolPurpose Of ALM Tool
Purpose Of ALM Tool
 
Agile ALM Tool Comparison
Agile ALM Tool ComparisonAgile ALM Tool Comparison
Agile ALM Tool Comparison
 

Recently uploaded

Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Product School
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
BookNet Canada
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
DianaGray10
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
Product School
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
Jemma Hussein Allen
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
DanBrown980551
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
Guy Korland
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
ThousandEyes
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
Paul Groth
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Tobias Schneck
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
Product School
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
Alison B. Lowndes
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
Prayukth K V
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Product School
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
Alan Dix
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
g2nightmarescribd
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Thierry Lestable
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
Cheryl Hung
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
Thijs Feryn
 

Recently uploaded (20)

Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...Transcript: Selling digital books in 2024: Insights from industry leaders - T...
Transcript: Selling digital books in 2024: Insights from industry leaders - T...
 
UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3UiPath Test Automation using UiPath Test Suite series, part 3
UiPath Test Automation using UiPath Test Suite series, part 3
 
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdfFIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
FIDO Alliance Osaka Seminar: FIDO Security Aspects.pdf
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...
 
GraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge GraphGraphRAG is All You need? LLM & Knowledge Graph
GraphRAG is All You need? LLM & Knowledge Graph
 
Assuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyesAssuring Contact Center Experiences for Your Customers With ThousandEyes
Assuring Contact Center Experiences for Your Customers With ThousandEyes
 
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMsTo Graph or Not to Graph Knowledge Graph Architectures and LLMs
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
 
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 previewState of ICS and IoT Cyber Threat Landscape Report 2024 preview
State of ICS and IoT Cyber Threat Landscape Report 2024 preview
 
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...
 
Epistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI supportEpistemic Interaction - tuning interfaces to provide information for AI support
Epistemic Interaction - tuning interfaces to provide information for AI support
 
Generating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using SmithyGenerating a custom Ruby SDK for your web service or Rails API using Smithy
Generating a custom Ruby SDK for your web service or Rails API using Smithy
 
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
Empowering NextGen Mobility via Large Action Model Infrastructure (LAMI): pav...
 
Key Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdfKey Trends Shaping the Future of Infrastructure.pdf
Key Trends Shaping the Future of Infrastructure.pdf
 
Accelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish CachingAccelerate your Kubernetes clusters with Varnish Caching
Accelerate your Kubernetes clusters with Varnish Caching
 

Test Management in TeamForge

  • 1. Test Management in TeamForge By Janardhanam Venkat CollabNetTeamForgeALMcovers all phases of the life cycle from plan, code, build and test to deploy. With the recent addition of TestLink, a widely adopted open source product for test management, TeamForge now has the added capability to create test case trackers and associate them with requirements. With TeamForge, users have the ability to execute test cases and store test results. TestLink utilizesatrackerto store test casesand also tie TestPlansintobuild. By integrating TeamForge with TestLink the test management features are available in TeamForge as part of end-to-end ALM solution. The main ideabehind thisintegrationis to associate Test Suite to the TeamForge requirements tracker epics, stories and tasks. The execution of Test Plan creates defects in TeamForge with associations to other TeamForge tools and data as shown in the following illustration.
  • 2. ImplementingEnterprise Agility TeamForge’s open architecture allows customers to integrate their favorite open source tools, commercial and home grown tools into the software lifecycle. TestLink leverages the ‘Open ALM Platform’ nature of TeamForge to provide a seamless, fully packaged and fully supported set of test capabilities for all users who want to participate in collaborative test management for local and distributed teams alike. This integration ensures complete traceability of all artifacts in the software lifecycle from requirements to test plan through test execution and reporting. TeamForge-TestLink integration results in extended capabilities both at a project level and at a company-wide community level – i.e., the organizational “Community Architecture”. The TestLink integration letsmanagersandstakeholders access continuous Test Management reports in TeamForge project pages. These real time reports bring a consolidated view of the TestLink within TeamForge, which is seamlessly viewed by the company wide stakeholders who have appropriate permissions. In addition, the workflow between TeamForge and TestLink can be rolled out to all projects and have a dramatic impact on improving overall release cycle velocity, software quality and reducing costs.
  • 3. Integration Details The TeamForge-TestLink integration is based on CollabNet’s Integrated Application Framework (IAF) similartohow Review Board was integrated with TeamForge. Using the IAF framework, single sign-on between TeamForgeand TestLink is managed, with TeamForge project and user creation replicated to TestLink. In addition, the TestLink permissions are displayed in TeamForge during user creation. Assumptions  TestLink hasa requirementmanagementtrackerthat can be linked to multiple bug trackers. As part of thisintegration, itisassumedthatrequirementsanddefectsare managedinTeamForge.
  • 4.  The TeamForge-TestLink integrationwascreatedwith multiple use cases gatheredviainterviews with current and potential customers. Enhancements and feature request will evolve as user experiences evolve. Basic Terminology Here’sa listof some of the basicCollabNetTeamForge-TestLinkterminologies:  Test Case:A setof inputs,executionpreconditions,andexpectedresults(outcomes) developed for a particular objective, such as to exercise a particular program path or to verify compliance with a specific requirement.  Test Suite: Organizes Test Cases to units and structures Test Specification into logical parts.  Test Plan: Created to execute Test Cases. Test Plans can be made up of Test Cases from the current Test Project. Test Plan includes Builds, Milestones, user assignment and Test Results.  Builds: A specificrelease of software.Each project in an organization is most likely made up of manyBuilds.If there are no Buildscreatedfora project thenthe execution of test cases will not allowed. The above capabilitiesare hierarchical,facilitatingcomplex testcase management. Forinstance,the TestSuite isa containerthatcan holdmultiple testcases. Testcasescanbe usedinmultiple TestPlans. The same TestPlancan be executedagainstmultiple builds.
  • 5. IntegrationFlow While creatingrequirements inTeamForge userscancreate TestSuitesas a placeholder in TestLink. For everyrequirement,the usercancreate a TestSuite in TestLink.Later, the user can get into TestLink and create test cases for the requirements. Once test cases are created, a Test Plan that bundles the test casesto be executed is created. Test Cases are reused in multiple Test Plans. For example, one would like to run all tests of a feature ‘A’ that has four test cases in Sprint 1. Later, a test plan, for example TestPlan1,canbe createdandall the four test cases can be associated to this Test Plan1. The same test casescan be reusedinTestPlan2asshownabove.Once the Test Plan is established, it can be executed and the user can update the test result as Pass/Failed/Blocked. For failed test cases a defect is automatically created in TeamForge defect tracker and association is created between the defect and the test case to maintain traceability. IntegrationOut of boxfeatures TestLink has the following features that can be leveraged by users:  Import/Export - Test Suites and Test cases can be imported and exported between projects in XML format.  Email notification –Notificationabouttestcase assignmentsandtestreports(once the report is generated in TestLink) can be sent to users via email.  Assignkeyword tags- Keywords are tagged to a group of test cases and these keywords can be used to categorize test case groups.
  • 6.  Customfields –Userscan extendthe mostimportantobjects(Testcases, Testsuites, Testplans) in TestLink with customized fields.  Support for Chinese, Japanese & Korean languages.  Version Test Case – There is an option to version every test case and the user can visually identify changes between Test Case versions using TestLink. CollabNetTestLinkIntegrationsto otherTools The Test Case execution is done manually, wherein users, after testing a case, will manually update PASS/FAILineachtestcase.There isan optionfor userstouse Seleniumtorunall test cases and update the TestLink withPASS/FAIL. Seleniumintegrationisavailable for functional testing and there is a JAVA API to update the test results in TestLink. Similarly, the Build artifact created in TestLink is a placeholder and the user has to create the build artifact manually to assign Test Plan to a build. Using TestLink Jenkins plug-in, the build job in Jenkins will create build artifact automatically in TestLink when a build is successful. In addition, few test management reports from TestLink will be displayed in TeamForge project page.
  • 7. Reports & Dashboard The CollabNetTestLinkintegrationprovides awide arrayof out-of-the-boxreportsthatcan be usedto generate the following forall permissionedusersinthe TeamForge system  TestReporton build • TestCase AssignmentOverview • Failed,Blocked,NotrunTestCases • TestCase notassignedto Test Plan • TestresultMatrix The CollabNetTestLinkintegrationalsoprovidescharts thatshow executionresultsbyTestSuite and overall testmetrics. Additional dashboardsindicate progress byproject:
  • 8. CustomerMigration Path The CollabNet customers have two migration paths. The first one is an existing TeamForge customer who is interested in using TestLink. In this case, a migration script has to be run to synchronize TeamForge userstoTestLink.Once the usersare migratedto TestLink,the permissiontoaccess TestLink for migrated users has to be manually created in TeamForge. The following illustration shows the migration path. The second migration path (casually called as glue) is for customers who are using TeamForge and TestLink as two separate systems that are not integrated. In this case there will be bi-directional migration,inwhich the TeamForge users are migrated to TestLink and the permission for the migrated usersto accessTestLink are createdmanuallyinTeamForge.The migration also moves selected project and its users, roles and permissions from TestLink to TeamForge. In addition, it will also auto-migrate requirementsfromTestLinktoTeamForge andthenassociate the migratedrequirements to Test Cases.
  • 9. Summary The CollabNetTeamForge-TestLink integration builds on top of TeamForge’ s capability to support the software development life cycle from plan, code, build and test to deploy. With TestLink integration, TeamForge now has the extended capability to create test case trackers and associate them with requirements andprovide traceabilityand test management right from requirements through release. Initial user feedback has been encouraging. You can attend my webinar on November 18th 2014 and signup now.I’dlike to hear what you think and what features you would like to see added. Please let me know venkatj@collab.net .