SlideShare a Scribd company logo
1 of 39
TMS using JIRA Customization
Yagnanarayana Dande
Project/Component/Story-Feature
• In JIRA Project will be top level entity
• Every Project will be having several Components
• Example - Project-1 is a Project and Comp-1,Comp-2 are
components
• Stories will be created per Project and will be associated with
one or more Components
Test Case
New IssueType called Test Case added into JIRA with CFs
Template
Test
Summar
y
Test Steps
Expected Results
Automatio
n Status Test Group
Componen
ts
Requirem
ent
Issue
Type
Affects
Version
Create
….
*Test Steps*
1….
2 ….
3….
*Expected Results*
1…..
2…. Manual Smoke Comp-1 Project1-1
Test
Case v1.3.0
Sample Test Case
Requirement Traceability
Test Case should be linked to Requirement
This allows Requirement Traceability
No. of Test Cases added in Latest Release
Test cycle creation
Assign Test Cases for Execution
Using JQL and Bulk Upload
Test cycle execution assignments
User Dashboard
Test Execution
Test progress in a Test cycle
Test progress at Component level
Test progress at Feature Level
Test execution report with teststeps
Test Cases for Different Platforms(OS)
Test Cases for Different Platforms(OS)
• Create Test Case for a Platform and upon review Clone them if
Test Steps are same for all the Platforms
• Create Different Test Cases for different Platforms if they are
platform dependent Test Cases
• Link a Test Case of different Environments
Creation of Automation Tasks using CSV upload
Test case assignment for automation
• Change Automation Status as “To be Automated” in Test Case
• Create a Sub-Task for Test Case
• Add to appropriate Test Cycle
• Assign it to a QA Engineer
Automation Activity
• QA Engineer looks at User Dashboard for Automation Activities
• QA Engineer will put it in Progress
• Complete it and mark it as Done
• Change Automation Status as “Automated” in Test Case
• Update “Automation Code” with Fully Qualified Class Name and
@Test Method Name
Automation assignments
Automation Progress
Create Regression Tests
• Get All Test Cases from Test Case Repository which are not
invalid
• Export them to CSV
• Change the Test Cycle and Assignee
• Import CSV
• Use Issue Key as Cloners in import menu
No. of Regressions across Versions
• Bug should be linked to Test Case with “is regressed by” link
type, if it a regression Bug.
• If not it should be linked to Test Case with “is caused by”
No. of regressions within Release
Test execution history for a testcase
JIRA Jenkins Integration
Pull Issue Details
Execute Test Cases
Update Test Results in JIRA
Jenkins Integration
• Get all issues of given Filter
• Get custom field from every Test Case
• Maintain a Map of JIRA ID to Custom Field
• Create a TestNG XML suite Programmatically and run it
• Get results programmatically from TestNG
• Update the issues by using Reverse mapping of Custom Field
to JIRA ID
Jenkins Integration
• https://github.com/rcarz/jira-client
• Create a Filter
• project = Project-1 AND issuetype = "Test Case" AND "Test Cycle" = "Version 4.0 - Cycle 1" AND "Automation Status" =
Automated AND status = "In Progress"
• Build jar from the code in last slide and run on Jenkins.
• This code needs following inputs
– JIRA URL
– JIRA Credentials
– Filter like “filter=10112”
– customField="customfield_10032"
– Note: You can get custom field name from JIRA Rest API and this name is different from what you see in JIRA UI
Add-ons Required
JQL Extensions for Querying linked issues
https://marketplace.atlassian.com/plugins/jql-extensions/cloud/pricing
Import Test Cases from CSV
https://confluence.atlassian.com/adminjiracloud/importing-data-
from-csv-776636762.html#ImportingdatafromCSV-format
Import Test Cases from CSV
Import Test Cases from CSV
Jenkins Integration
package com.company.qa.project.test;
import java.util.ArrayList;
import java.util.Arrays;
import java.util.Collection;
import java.util.HashMap;
import java.util.List;
import java.util.Map;
import org.testng.IReporter;
import org.testng.ISuite;
import org.testng.ISuiteResult;
Issue Links Used
Filters Used
Filter Name JQL
Bugs with Test Cases project = Project1 AND linkType = "is regressed by" AND issuetype = Bug AND affectedVersion = "Version 3.0"
Test Case Repository project = Project1 AND issuetype = "Test Case" AND (linkType not in (clones) OR linkType is EMPTY)
Test Cases Added in Latest Version project = Project1 AND issuetype = "Test Case" AND affectedVersion = "Version 4.0"
Test Cases Caused Regression project = Project1 AND linkType = regresses AND issuetype = "Test Case"
Test Cases With Open Bugs
project = Project1 AND issuetype = "Test Case" AND status = "TC - Failed" AND linkedIssueType = Bug AND
linkedIssueStatus = "To Do"
Test Execution of Latest Test Cycle project = Project1 AND issuetype = "Test Case" AND "Test Cycle" = "Version 4.0 - Cycle 1"
Requirement Traceability project = Project1 AND issuetype = Story AND linkType = "is requirement of"
All Bugs with Test Cases
project = Project1 AND (linkType = "is caused by" OR linkType = "is regressed by") AND issuetype = Bug AND
affectedVersion = "Version 3.0"
Automation Progress project = Project1 AND issuetype = Sub-task AND "Test Cycle" = "Version 4.0 - Cycle 1"
Regression Bugs with Test Cases project = Project1 AND linkType = "is regressed by" AND issuetype = Bug AND affectedVersion = "Version 3.0"
Automated Tests Ready to Run
project = Project1 AND issuetype = "Test Case" AND "Test Cycle" = "Version 4.0 - Cycle 1" AND "Automation
Status" = Automated AND status = "In Progress"
Test Execution History
project = Project1 AND issuetype = "Test Case" AND linkType in (clones) AND linksIssue = Project1-32 ORDER
BY "Test Cycle" DESC
Configuration for Environments
{
"config.version" : "2.0",
"config.project.from.csv" : "false",
"config.encoding" : "UTF-8",
"config.email.suffix" : "@",
"config.field.mappings" : {
"Custom field (Test Group)" : {
"existing.custom.field" : "10026"
},
"Issue Type" : {
Thank you
yagna.bitspilani@gmail.com

More Related Content

What's hot

Automated testing of ASP .Net Core applications
Automated testing of ASP .Net Core applications Automated testing of ASP .Net Core applications
Automated testing of ASP .Net Core applications nispas
 
Automation Testing with Test Complete
Automation Testing with Test CompleteAutomation Testing with Test Complete
Automation Testing with Test CompleteVartika Saxena
 
Implementing checkpoint in qtp
Implementing checkpoint in qtpImplementing checkpoint in qtp
Implementing checkpoint in qtpRamu Palanki
 
qTest <> TestProject Integration Webinar
qTest <> TestProject Integration WebinarqTest <> TestProject Integration Webinar
qTest <> TestProject Integration WebinarKevin Dunne
 
Testing with test_complete
Testing with test_completeTesting with test_complete
Testing with test_completebinuiweb
 
Automation framework
Automation framework Automation framework
Automation framework ITeLearn
 
Unit Testing vs Integration Testing
Unit Testing vs Integration TestingUnit Testing vs Integration Testing
Unit Testing vs Integration TestingRock Interview
 
Refactoring Legacy Web Forms for Test Automation
Refactoring Legacy Web Forms for Test AutomationRefactoring Legacy Web Forms for Test Automation
Refactoring Legacy Web Forms for Test AutomationStephen Fuqua
 
Keyword Driven Testing
Keyword Driven TestingKeyword Driven Testing
Keyword Driven TestingMaveryx
 
Software testing tools
Software testing toolsSoftware testing tools
Software testing toolsGaurav Paliwal
 
Unit and integration Testing
Unit and integration TestingUnit and integration Testing
Unit and integration TestingDavid Berliner
 
Journey To Excellence
Journey To ExcellenceJourney To Excellence
Journey To ExcellenceWalter Mamed
 
Code Kata: String Calculator in Flex
Code Kata: String Calculator in FlexCode Kata: String Calculator in Flex
Code Kata: String Calculator in FlexChris Farrell
 
Automation Testing with TestComplete
Automation Testing with TestCompleteAutomation Testing with TestComplete
Automation Testing with TestCompleteRomSoft SRL
 

What's hot (20)

Automated testing of ASP .Net Core applications
Automated testing of ASP .Net Core applications Automated testing of ASP .Net Core applications
Automated testing of ASP .Net Core applications
 
Automation Testing with Test Complete
Automation Testing with Test CompleteAutomation Testing with Test Complete
Automation Testing with Test Complete
 
Implementing checkpoint in qtp
Implementing checkpoint in qtpImplementing checkpoint in qtp
Implementing checkpoint in qtp
 
qTest <> TestProject Integration Webinar
qTest <> TestProject Integration WebinarqTest <> TestProject Integration Webinar
qTest <> TestProject Integration Webinar
 
Testing with test_complete
Testing with test_completeTesting with test_complete
Testing with test_complete
 
Automation framework
Automation framework Automation framework
Automation framework
 
Testing_with_TestComplete
Testing_with_TestCompleteTesting_with_TestComplete
Testing_with_TestComplete
 
Unit Testing vs Integration Testing
Unit Testing vs Integration TestingUnit Testing vs Integration Testing
Unit Testing vs Integration Testing
 
Refactoring Legacy Web Forms for Test Automation
Refactoring Legacy Web Forms for Test AutomationRefactoring Legacy Web Forms for Test Automation
Refactoring Legacy Web Forms for Test Automation
 
Keyword Driven Testing
Keyword Driven TestingKeyword Driven Testing
Keyword Driven Testing
 
Software testing tools
Software testing toolsSoftware testing tools
Software testing tools
 
Test automation proposal
Test automation proposalTest automation proposal
Test automation proposal
 
Intro to junit
Intro to junitIntro to junit
Intro to junit
 
Unit Testing Your Application
Unit Testing Your ApplicationUnit Testing Your Application
Unit Testing Your Application
 
Unit and integration Testing
Unit and integration TestingUnit and integration Testing
Unit and integration Testing
 
Journey To Excellence
Journey To ExcellenceJourney To Excellence
Journey To Excellence
 
Code Kata: String Calculator in Flex
Code Kata: String Calculator in FlexCode Kata: String Calculator in Flex
Code Kata: String Calculator in Flex
 
Automation Testing with TestComplete
Automation Testing with TestCompleteAutomation Testing with TestComplete
Automation Testing with TestComplete
 
Web service testing using QTP (UFT)
Web service testing using QTP (UFT)Web service testing using QTP (UFT)
Web service testing using QTP (UFT)
 
GardiasResume2015
GardiasResume2015GardiasResume2015
GardiasResume2015
 

Viewers also liked

Using JIRA Software for Issue Tracking
Using JIRA Software for Issue TrackingUsing JIRA Software for Issue Tracking
Using JIRA Software for Issue TrackingAnjali Rao
 
Jira as a Tool for Test Management
Jira as a Tool for Test ManagementJira as a Tool for Test Management
Jira as a Tool for Test ManagementMaija Laksa
 
Introduction To Jira
Introduction To JiraIntroduction To Jira
Introduction To JiraHua Soon Sim
 
Jira as a Project Management Tool
Jira as a Project Management ToolJira as a Project Management Tool
Jira as a Project Management ToolPaolo Mottadelli
 
QTDA_[Scrum vs Kanban]_XP
QTDA_[Scrum vs  Kanban]_XPQTDA_[Scrum vs  Kanban]_XP
QTDA_[Scrum vs Kanban]_XPPhúc Thành
 
ScrumDay Vietnam 2013: Công nghệ thông tin trong kỷ nguyên toàn cầu hóa - Chu...
ScrumDay Vietnam 2013: Công nghệ thông tin trong kỷ nguyên toàn cầu hóa - Chu...ScrumDay Vietnam 2013: Công nghệ thông tin trong kỷ nguyên toàn cầu hóa - Chu...
ScrumDay Vietnam 2013: Công nghệ thông tin trong kỷ nguyên toàn cầu hóa - Chu...Vu Hung Nguyen
 
Anatomy of a JIRA Feature - Atlassian Summit 2010 - Lightning Talks
Anatomy of a JIRA Feature - Atlassian Summit 2010 - Lightning TalksAnatomy of a JIRA Feature - Atlassian Summit 2010 - Lightning Talks
Anatomy of a JIRA Feature - Atlassian Summit 2010 - Lightning TalksAtlassian
 
Thesis - An application to manage software development process.
Thesis - An application to manage software development process.Thesis - An application to manage software development process.
Thesis - An application to manage software development process.Khánh Trần
 
2. ap dung lean startup vao be rich slide
2. ap dung lean startup vao be rich slide2. ap dung lean startup vao be rich slide
2. ap dung lean startup vao be rich slideBeRich
 
Kyna.vn - Growth hack from small changes
Kyna.vn - Growth hack from small changesKyna.vn - Growth hack from small changes
Kyna.vn - Growth hack from small changesDuong Le
 
Kĩ năng ứng dụng CNTT trong tìm việc làm và khởi nghiệp - ĐH KHXH& NV - Micro...
Kĩ năng ứng dụng CNTT trong tìm việc làm và khởi nghiệp - ĐH KHXH& NV - Micro...Kĩ năng ứng dụng CNTT trong tìm việc làm và khởi nghiệp - ĐH KHXH& NV - Micro...
Kĩ năng ứng dụng CNTT trong tìm việc làm và khởi nghiệp - ĐH KHXH& NV - Micro...Duong Le
 
Jira jenkins integration
Jira jenkins integrationJira jenkins integration
Jira jenkins integrationelaqeem
 
Ctxaug 02 amd atlassian build pipeline
Ctxaug 02   amd atlassian build pipelineCtxaug 02   amd atlassian build pipeline
Ctxaug 02 amd atlassian build pipelinepraecipio
 
Đường vào agile - 2013
Đường vào agile - 2013Đường vào agile - 2013
Đường vào agile - 2013DUONG Trong Tan
 
ScrumDay Vietnam 2013: PMBOK là Waterfall hay Agile? - Phùng Thanh Cường
ScrumDay Vietnam 2013: PMBOK là Waterfall hay Agile? - Phùng Thanh CườngScrumDay Vietnam 2013: PMBOK là Waterfall hay Agile? - Phùng Thanh Cường
ScrumDay Vietnam 2013: PMBOK là Waterfall hay Agile? - Phùng Thanh CườngVu Hung Nguyen
 
ScrumDay Vietnam 2013: Phương pháp luận phần mềm - Truyền thống và Agile - Ng...
ScrumDay Vietnam 2013: Phương pháp luận phần mềm - Truyền thống và Agile - Ng...ScrumDay Vietnam 2013: Phương pháp luận phần mềm - Truyền thống và Agile - Ng...
ScrumDay Vietnam 2013: Phương pháp luận phần mềm - Truyền thống và Agile - Ng...Vu Hung Nguyen
 
ScrumDay Vietnam 2013: Ứng dụng Jira trong Phát triển Phần mềm Linh hoạt - Ng...
ScrumDay Vietnam 2013: Ứng dụng Jira trong Phát triển Phần mềm Linh hoạt - Ng...ScrumDay Vietnam 2013: Ứng dụng Jira trong Phát triển Phần mềm Linh hoạt - Ng...
ScrumDay Vietnam 2013: Ứng dụng Jira trong Phát triển Phần mềm Linh hoạt - Ng...Vu Hung Nguyen
 
Jira and Confluence - How the company behind those products works - Anatoli K...
Jira and Confluence - How the company behind those products works - Anatoli K...Jira and Confluence - How the company behind those products works - Anatoli K...
Jira and Confluence - How the company behind those products works - Anatoli K...Dominic Trần
 
Business value pipeline with atlassian products
Business value pipeline with atlassian productsBusiness value pipeline with atlassian products
Business value pipeline with atlassian products智治 長沢
 

Viewers also liked (20)

Using JIRA Software for Issue Tracking
Using JIRA Software for Issue TrackingUsing JIRA Software for Issue Tracking
Using JIRA Software for Issue Tracking
 
Jira as a Tool for Test Management
Jira as a Tool for Test ManagementJira as a Tool for Test Management
Jira as a Tool for Test Management
 
Introduction To Jira
Introduction To JiraIntroduction To Jira
Introduction To Jira
 
Jira as a Project Management Tool
Jira as a Project Management ToolJira as a Project Management Tool
Jira as a Project Management Tool
 
QTDA_[Scrum vs Kanban]_XP
QTDA_[Scrum vs  Kanban]_XPQTDA_[Scrum vs  Kanban]_XP
QTDA_[Scrum vs Kanban]_XP
 
ScrumDay Vietnam 2013: Công nghệ thông tin trong kỷ nguyên toàn cầu hóa - Chu...
ScrumDay Vietnam 2013: Công nghệ thông tin trong kỷ nguyên toàn cầu hóa - Chu...ScrumDay Vietnam 2013: Công nghệ thông tin trong kỷ nguyên toàn cầu hóa - Chu...
ScrumDay Vietnam 2013: Công nghệ thông tin trong kỷ nguyên toàn cầu hóa - Chu...
 
Anatomy of a JIRA Feature - Atlassian Summit 2010 - Lightning Talks
Anatomy of a JIRA Feature - Atlassian Summit 2010 - Lightning TalksAnatomy of a JIRA Feature - Atlassian Summit 2010 - Lightning Talks
Anatomy of a JIRA Feature - Atlassian Summit 2010 - Lightning Talks
 
Thesis - An application to manage software development process.
Thesis - An application to manage software development process.Thesis - An application to manage software development process.
Thesis - An application to manage software development process.
 
2. ap dung lean startup vao be rich slide
2. ap dung lean startup vao be rich slide2. ap dung lean startup vao be rich slide
2. ap dung lean startup vao be rich slide
 
Kyna.vn - Growth hack from small changes
Kyna.vn - Growth hack from small changesKyna.vn - Growth hack from small changes
Kyna.vn - Growth hack from small changes
 
Kĩ năng ứng dụng CNTT trong tìm việc làm và khởi nghiệp - ĐH KHXH& NV - Micro...
Kĩ năng ứng dụng CNTT trong tìm việc làm và khởi nghiệp - ĐH KHXH& NV - Micro...Kĩ năng ứng dụng CNTT trong tìm việc làm và khởi nghiệp - ĐH KHXH& NV - Micro...
Kĩ năng ứng dụng CNTT trong tìm việc làm và khởi nghiệp - ĐH KHXH& NV - Micro...
 
Jira jenkins integration
Jira jenkins integrationJira jenkins integration
Jira jenkins integration
 
Ctxaug 02 amd atlassian build pipeline
Ctxaug 02   amd atlassian build pipelineCtxaug 02   amd atlassian build pipeline
Ctxaug 02 amd atlassian build pipeline
 
Đường vào agile - 2013
Đường vào agile - 2013Đường vào agile - 2013
Đường vào agile - 2013
 
ScrumDay Vietnam 2013: PMBOK là Waterfall hay Agile? - Phùng Thanh Cường
ScrumDay Vietnam 2013: PMBOK là Waterfall hay Agile? - Phùng Thanh CườngScrumDay Vietnam 2013: PMBOK là Waterfall hay Agile? - Phùng Thanh Cường
ScrumDay Vietnam 2013: PMBOK là Waterfall hay Agile? - Phùng Thanh Cường
 
ScrumDay Vietnam 2013: Phương pháp luận phần mềm - Truyền thống và Agile - Ng...
ScrumDay Vietnam 2013: Phương pháp luận phần mềm - Truyền thống và Agile - Ng...ScrumDay Vietnam 2013: Phương pháp luận phần mềm - Truyền thống và Agile - Ng...
ScrumDay Vietnam 2013: Phương pháp luận phần mềm - Truyền thống và Agile - Ng...
 
ScrumDay Vietnam 2013: Ứng dụng Jira trong Phát triển Phần mềm Linh hoạt - Ng...
ScrumDay Vietnam 2013: Ứng dụng Jira trong Phát triển Phần mềm Linh hoạt - Ng...ScrumDay Vietnam 2013: Ứng dụng Jira trong Phát triển Phần mềm Linh hoạt - Ng...
ScrumDay Vietnam 2013: Ứng dụng Jira trong Phát triển Phần mềm Linh hoạt - Ng...
 
Jira and Confluence - How the company behind those products works - Anatoli K...
Jira and Confluence - How the company behind those products works - Anatoli K...Jira and Confluence - How the company behind those products works - Anatoli K...
Jira and Confluence - How the company behind those products works - Anatoli K...
 
Business value pipeline with atlassian products
Business value pipeline with atlassian productsBusiness value pipeline with atlassian products
Business value pipeline with atlassian products
 
JIRA & Stach, The Love Story
JIRA & Stach, The Love StoryJIRA & Stach, The Love Story
JIRA & Stach, The Love Story
 

Similar to Test Management System (TMS) using JIRA Customization

Jira work flows
Jira work flowsJira work flows
Jira work flowsShivaraj R
 
Software testing: an introduction - 2017
Software testing: an introduction - 2017Software testing: an introduction - 2017
Software testing: an introduction - 2017XavierDevroey
 
QA Fest 2017. Владимир Примаков. QA метрики. Взгляд на качество с разных стор...
QA Fest 2017. Владимир Примаков. QA метрики. Взгляд на качество с разных стор...QA Fest 2017. Владимир Примаков. QA метрики. Взгляд на качество с разных стор...
QA Fest 2017. Владимир Примаков. QA метрики. Взгляд на качество с разных стор...QAFest
 
Advanced Java Testing @ POSS 2019
Advanced Java Testing @ POSS 2019Advanced Java Testing @ POSS 2019
Advanced Java Testing @ POSS 2019Vincent Massol
 
New types of tests for Java projects
New types of tests for Java projectsNew types of tests for Java projects
New types of tests for Java projectsVincent Massol
 
Software testing introduction
Software testing introductionSoftware testing introduction
Software testing introductionSriman Eshwar
 
How do you tame a big ball of mud? One test at a time.
How do you tame a big ball of mud? One test at a time.How do you tame a big ball of mud? One test at a time.
How do you tame a big ball of mud? One test at a time.Matt Eland
 
Automated Testing Environment by Bugzilla, Testopia and Jenkins
Automated Testing Environment by Bugzilla, Testopia and JenkinsAutomated Testing Environment by Bugzilla, Testopia and Jenkins
Automated Testing Environment by Bugzilla, Testopia and Jenkinswalkerchang
 
Testing 2: Advanced Test Management
Testing 2: Advanced Test Management Testing 2: Advanced Test Management
Testing 2: Advanced Test Management Inflectra
 
Test parallelization using Jenkins
Test parallelization using JenkinsTest parallelization using Jenkins
Test parallelization using JenkinsRogue Wave Software
 
Continuous Integration on AWS
Continuous Integration on AWSContinuous Integration on AWS
Continuous Integration on AWSPetar Petrov
 
How do you implement Continuous Delivery? Part 3: All about Pipelines
How do you implement Continuous Delivery? Part 3: All about PipelinesHow do you implement Continuous Delivery? Part 3: All about Pipelines
How do you implement Continuous Delivery? Part 3: All about PipelinesThoughtworks
 
Simple tools to fight bigger quality battle
Simple tools to fight bigger quality battleSimple tools to fight bigger quality battle
Simple tools to fight bigger quality battleAnand Ramdeo
 
Presentation sem 1.pptx
Presentation sem 1.pptxPresentation sem 1.pptx
Presentation sem 1.pptxdendi65
 
Automated Developer Testing: Achievements and Challenges
Automated Developer Testing: Achievements and ChallengesAutomated Developer Testing: Achievements and Challenges
Automated Developer Testing: Achievements and ChallengesTao Xie
 
Tech talk specflow_bddx_hassa_nagy
Tech talk specflow_bddx_hassa_nagyTech talk specflow_bddx_hassa_nagy
Tech talk specflow_bddx_hassa_nagySkills Matter
 
John Kent - An Entity Model for Software Testing
John Kent - An Entity Model for Software TestingJohn Kent - An Entity Model for Software Testing
John Kent - An Entity Model for Software TestingTEST Huddle
 
03 test specification and execution
03   test specification and execution03   test specification and execution
03 test specification and executionClemens Reijnen
 

Similar to Test Management System (TMS) using JIRA Customization (20)

Testing Angular
Testing AngularTesting Angular
Testing Angular
 
Jira work flows
Jira work flowsJira work flows
Jira work flows
 
Software testing: an introduction - 2017
Software testing: an introduction - 2017Software testing: an introduction - 2017
Software testing: an introduction - 2017
 
QA Fest 2017. Владимир Примаков. QA метрики. Взгляд на качество с разных стор...
QA Fest 2017. Владимир Примаков. QA метрики. Взгляд на качество с разных стор...QA Fest 2017. Владимир Примаков. QA метрики. Взгляд на качество с разных стор...
QA Fest 2017. Владимир Примаков. QA метрики. Взгляд на качество с разных стор...
 
Advanced Java Testing @ POSS 2019
Advanced Java Testing @ POSS 2019Advanced Java Testing @ POSS 2019
Advanced Java Testing @ POSS 2019
 
New types of tests for Java projects
New types of tests for Java projectsNew types of tests for Java projects
New types of tests for Java projects
 
Software testing introduction
Software testing introductionSoftware testing introduction
Software testing introduction
 
How do you tame a big ball of mud? One test at a time.
How do you tame a big ball of mud? One test at a time.How do you tame a big ball of mud? One test at a time.
How do you tame a big ball of mud? One test at a time.
 
Automated Testing Environment by Bugzilla, Testopia and Jenkins
Automated Testing Environment by Bugzilla, Testopia and JenkinsAutomated Testing Environment by Bugzilla, Testopia and Jenkins
Automated Testing Environment by Bugzilla, Testopia and Jenkins
 
Bug zillatestopiajenkins
Bug zillatestopiajenkinsBug zillatestopiajenkins
Bug zillatestopiajenkins
 
Testing 2: Advanced Test Management
Testing 2: Advanced Test Management Testing 2: Advanced Test Management
Testing 2: Advanced Test Management
 
Test parallelization using Jenkins
Test parallelization using JenkinsTest parallelization using Jenkins
Test parallelization using Jenkins
 
Continuous Integration on AWS
Continuous Integration on AWSContinuous Integration on AWS
Continuous Integration on AWS
 
How do you implement Continuous Delivery? Part 3: All about Pipelines
How do you implement Continuous Delivery? Part 3: All about PipelinesHow do you implement Continuous Delivery? Part 3: All about Pipelines
How do you implement Continuous Delivery? Part 3: All about Pipelines
 
Simple tools to fight bigger quality battle
Simple tools to fight bigger quality battleSimple tools to fight bigger quality battle
Simple tools to fight bigger quality battle
 
Presentation sem 1.pptx
Presentation sem 1.pptxPresentation sem 1.pptx
Presentation sem 1.pptx
 
Automated Developer Testing: Achievements and Challenges
Automated Developer Testing: Achievements and ChallengesAutomated Developer Testing: Achievements and Challenges
Automated Developer Testing: Achievements and Challenges
 
Tech talk specflow_bddx_hassa_nagy
Tech talk specflow_bddx_hassa_nagyTech talk specflow_bddx_hassa_nagy
Tech talk specflow_bddx_hassa_nagy
 
John Kent - An Entity Model for Software Testing
John Kent - An Entity Model for Software TestingJohn Kent - An Entity Model for Software Testing
John Kent - An Entity Model for Software Testing
 
03 test specification and execution
03   test specification and execution03   test specification and execution
03 test specification and execution
 

Recently uploaded

英国UN学位证,北安普顿大学毕业证书1:1制作
英国UN学位证,北安普顿大学毕业证书1:1制作英国UN学位证,北安普顿大学毕业证书1:1制作
英国UN学位证,北安普顿大学毕业证书1:1制作qr0udbr0
 
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte GermanySuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte GermanyChristoph Pohl
 
Software Project Health Check: Best Practices and Techniques for Your Product...
Software Project Health Check: Best Practices and Techniques for Your Product...Software Project Health Check: Best Practices and Techniques for Your Product...
Software Project Health Check: Best Practices and Techniques for Your Product...Velvetech LLC
 
Implementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with AzureImplementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with AzureDinusha Kumarasiri
 
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...soniya singh
 
Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...
Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...
Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...OnePlan Solutions
 
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024StefanoLambiase
 
Introduction Computer Science - Software Design.pdf
Introduction Computer Science - Software Design.pdfIntroduction Computer Science - Software Design.pdf
Introduction Computer Science - Software Design.pdfFerryKemperman
 
SpotFlow: Tracking Method Calls and States at Runtime
SpotFlow: Tracking Method Calls and States at RuntimeSpotFlow: Tracking Method Calls and States at Runtime
SpotFlow: Tracking Method Calls and States at Runtimeandrehoraa
 
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfGOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfAlina Yurenko
 
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...stazi3110
 
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样umasea
 
MYjobs Presentation Django-based project
MYjobs Presentation Django-based projectMYjobs Presentation Django-based project
MYjobs Presentation Django-based projectAnoyGreter
 
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio, Inc.
 
EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityNeo4j
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideChristina Lin
 
Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024Andreas Granig
 
Unveiling the Future: Sylius 2.0 New Features
Unveiling the Future: Sylius 2.0 New FeaturesUnveiling the Future: Sylius 2.0 New Features
Unveiling the Future: Sylius 2.0 New FeaturesŁukasz Chruściel
 
Xen Safety Embedded OSS Summit April 2024 v4.pdf
Xen Safety Embedded OSS Summit April 2024 v4.pdfXen Safety Embedded OSS Summit April 2024 v4.pdf
Xen Safety Embedded OSS Summit April 2024 v4.pdfStefano Stabellini
 

Recently uploaded (20)

英国UN学位证,北安普顿大学毕业证书1:1制作
英国UN学位证,北安普顿大学毕业证书1:1制作英国UN学位证,北安普顿大学毕业证书1:1制作
英国UN学位证,北安普顿大学毕业证书1:1制作
 
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte GermanySuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
SuccessFactors 1H 2024 Release - Sneak-Peek by Deloitte Germany
 
Software Project Health Check: Best Practices and Techniques for Your Product...
Software Project Health Check: Best Practices and Techniques for Your Product...Software Project Health Check: Best Practices and Techniques for Your Product...
Software Project Health Check: Best Practices and Techniques for Your Product...
 
Implementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with AzureImplementing Zero Trust strategy with Azure
Implementing Zero Trust strategy with Azure
 
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...
 
Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...
Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...
Maximizing Efficiency and Profitability with OnePlan’s Professional Service A...
 
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
Dealing with Cultural Dispersion — Stefano Lambiase — ICSE-SEIS 2024
 
Introduction Computer Science - Software Design.pdf
Introduction Computer Science - Software Design.pdfIntroduction Computer Science - Software Design.pdf
Introduction Computer Science - Software Design.pdf
 
SpotFlow: Tracking Method Calls and States at Runtime
SpotFlow: Tracking Method Calls and States at RuntimeSpotFlow: Tracking Method Calls and States at Runtime
SpotFlow: Tracking Method Calls and States at Runtime
 
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdfGOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
GOING AOT WITH GRAALVM – DEVOXX GREECE.pdf
 
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
Building a General PDE Solving Framework with Symbolic-Numeric Scientific Mac...
 
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
办理学位证(UQ文凭证书)昆士兰大学毕业证成绩单原版一模一样
 
MYjobs Presentation Django-based project
MYjobs Presentation Django-based projectMYjobs Presentation Django-based project
MYjobs Presentation Django-based project
 
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed Data
 
EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered Sustainability
 
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideBuilding Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
Building Real-Time Data Pipelines: Stream & Batch Processing workshop Slide
 
2.pdf Ejercicios de programación competitiva
2.pdf Ejercicios de programación competitiva2.pdf Ejercicios de programación competitiva
2.pdf Ejercicios de programación competitiva
 
Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024Automate your Kamailio Test Calls - Kamailio World 2024
Automate your Kamailio Test Calls - Kamailio World 2024
 
Unveiling the Future: Sylius 2.0 New Features
Unveiling the Future: Sylius 2.0 New FeaturesUnveiling the Future: Sylius 2.0 New Features
Unveiling the Future: Sylius 2.0 New Features
 
Xen Safety Embedded OSS Summit April 2024 v4.pdf
Xen Safety Embedded OSS Summit April 2024 v4.pdfXen Safety Embedded OSS Summit April 2024 v4.pdf
Xen Safety Embedded OSS Summit April 2024 v4.pdf
 

Test Management System (TMS) using JIRA Customization

  • 1. TMS using JIRA Customization Yagnanarayana Dande
  • 2. Project/Component/Story-Feature • In JIRA Project will be top level entity • Every Project will be having several Components • Example - Project-1 is a Project and Comp-1,Comp-2 are components • Stories will be created per Project and will be associated with one or more Components
  • 3. Test Case New IssueType called Test Case added into JIRA with CFs
  • 4. Template Test Summar y Test Steps Expected Results Automatio n Status Test Group Componen ts Requirem ent Issue Type Affects Version Create …. *Test Steps* 1…. 2 …. 3…. *Expected Results* 1….. 2…. Manual Smoke Comp-1 Project1-1 Test Case v1.3.0
  • 6. Requirement Traceability Test Case should be linked to Requirement This allows Requirement Traceability
  • 7. No. of Test Cases added in Latest Release
  • 9. Assign Test Cases for Execution Using JQL and Bulk Upload
  • 10. Test cycle execution assignments
  • 13. Test progress in a Test cycle
  • 14. Test progress at Component level
  • 15. Test progress at Feature Level
  • 16. Test execution report with teststeps
  • 17. Test Cases for Different Platforms(OS)
  • 18. Test Cases for Different Platforms(OS) • Create Test Case for a Platform and upon review Clone them if Test Steps are same for all the Platforms • Create Different Test Cases for different Platforms if they are platform dependent Test Cases • Link a Test Case of different Environments
  • 19. Creation of Automation Tasks using CSV upload
  • 20. Test case assignment for automation • Change Automation Status as “To be Automated” in Test Case • Create a Sub-Task for Test Case • Add to appropriate Test Cycle • Assign it to a QA Engineer
  • 21. Automation Activity • QA Engineer looks at User Dashboard for Automation Activities • QA Engineer will put it in Progress • Complete it and mark it as Done • Change Automation Status as “Automated” in Test Case • Update “Automation Code” with Fully Qualified Class Name and @Test Method Name
  • 24. Create Regression Tests • Get All Test Cases from Test Case Repository which are not invalid • Export them to CSV • Change the Test Cycle and Assignee • Import CSV • Use Issue Key as Cloners in import menu
  • 25. No. of Regressions across Versions • Bug should be linked to Test Case with “is regressed by” link type, if it a regression Bug. • If not it should be linked to Test Case with “is caused by”
  • 26. No. of regressions within Release
  • 27. Test execution history for a testcase
  • 28. JIRA Jenkins Integration Pull Issue Details Execute Test Cases Update Test Results in JIRA
  • 29. Jenkins Integration • Get all issues of given Filter • Get custom field from every Test Case • Maintain a Map of JIRA ID to Custom Field • Create a TestNG XML suite Programmatically and run it • Get results programmatically from TestNG • Update the issues by using Reverse mapping of Custom Field to JIRA ID
  • 30. Jenkins Integration • https://github.com/rcarz/jira-client • Create a Filter • project = Project-1 AND issuetype = "Test Case" AND "Test Cycle" = "Version 4.0 - Cycle 1" AND "Automation Status" = Automated AND status = "In Progress" • Build jar from the code in last slide and run on Jenkins. • This code needs following inputs – JIRA URL – JIRA Credentials – Filter like “filter=10112” – customField="customfield_10032" – Note: You can get custom field name from JIRA Rest API and this name is different from what you see in JIRA UI
  • 31. Add-ons Required JQL Extensions for Querying linked issues https://marketplace.atlassian.com/plugins/jql-extensions/cloud/pricing
  • 32. Import Test Cases from CSV https://confluence.atlassian.com/adminjiracloud/importing-data- from-csv-776636762.html#ImportingdatafromCSV-format
  • 33. Import Test Cases from CSV
  • 34. Import Test Cases from CSV
  • 35. Jenkins Integration package com.company.qa.project.test; import java.util.ArrayList; import java.util.Arrays; import java.util.Collection; import java.util.HashMap; import java.util.List; import java.util.Map; import org.testng.IReporter; import org.testng.ISuite; import org.testng.ISuiteResult;
  • 37. Filters Used Filter Name JQL Bugs with Test Cases project = Project1 AND linkType = "is regressed by" AND issuetype = Bug AND affectedVersion = "Version 3.0" Test Case Repository project = Project1 AND issuetype = "Test Case" AND (linkType not in (clones) OR linkType is EMPTY) Test Cases Added in Latest Version project = Project1 AND issuetype = "Test Case" AND affectedVersion = "Version 4.0" Test Cases Caused Regression project = Project1 AND linkType = regresses AND issuetype = "Test Case" Test Cases With Open Bugs project = Project1 AND issuetype = "Test Case" AND status = "TC - Failed" AND linkedIssueType = Bug AND linkedIssueStatus = "To Do" Test Execution of Latest Test Cycle project = Project1 AND issuetype = "Test Case" AND "Test Cycle" = "Version 4.0 - Cycle 1" Requirement Traceability project = Project1 AND issuetype = Story AND linkType = "is requirement of" All Bugs with Test Cases project = Project1 AND (linkType = "is caused by" OR linkType = "is regressed by") AND issuetype = Bug AND affectedVersion = "Version 3.0" Automation Progress project = Project1 AND issuetype = Sub-task AND "Test Cycle" = "Version 4.0 - Cycle 1" Regression Bugs with Test Cases project = Project1 AND linkType = "is regressed by" AND issuetype = Bug AND affectedVersion = "Version 3.0" Automated Tests Ready to Run project = Project1 AND issuetype = "Test Case" AND "Test Cycle" = "Version 4.0 - Cycle 1" AND "Automation Status" = Automated AND status = "In Progress" Test Execution History project = Project1 AND issuetype = "Test Case" AND linkType in (clones) AND linksIssue = Project1-32 ORDER BY "Test Cycle" DESC
  • 38. Configuration for Environments { "config.version" : "2.0", "config.project.from.csv" : "false", "config.encoding" : "UTF-8", "config.email.suffix" : "@", "config.field.mappings" : { "Custom field (Test Group)" : { "existing.custom.field" : "10026" }, "Issue Type" : {