SlideShare a Scribd company logo
Case Procountor: Zephyr test tool deployment
Zephyr Test Tool Deployment | Procountor
Knowit Oy, Jussi Rautio 6.10.2015
PAGE 2 [CONFIDENTIAL] THIS IS KNOWIT6.10.2015
www.knowit.fi
6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.03
Senior Quality Consultant, Service Productization Responsible, Service
Manager, Test Tool Technical support, Test Tool Deployments and
Migrations…
• Speaks, train, coach and mentor about
• How to take new testing tool in use and best practices.
• User trainings for testers, test managers, product owners and quality managers
• Metrics and KPI`s benchmarking and design
• Data Quality
• Process enhancements
• Etc.
JUSSI RAUTIO, KNOWIT
www.knowit.fi
KNOWIT
Scandinavian company that is listed on Nordic
Exchange Stockholm
Knowit offering in Finland:
• Test and quality management
• Solutions for digital business and information
management
• Development and maintenance of client-
specific applications
6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.04
www.knowit.fi
02.09.15 [CONFIDENTIAL] THIS IS KNOWITPAGE 5
• Leading provider of cloud accounting software
• Used by over 10 000 companies and over 400
accounting offices
• Available in Finland, Norway, Sweden and
Denmark
02.09.15 [CONFIDENTIAL] THIS IS KNOWITPAGE 6
PROCOUNTOR ATLASSIAN ENVIRONMENT
6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.07
Crowd
JIRA FisheyeConfluence
Refinedwiki
JIRAagile
ZephyrforJIRA
Timesheetreports
Crucible
Confluence
• Social Intranet
• Knowledge Management
JIRA
• Requirement management
• Product development (scrum)
• Test management
Fisheye/Crucible
• Source code browsing
• Code review
Crowd
• User management
*500
*50*100*250
Hosted by: www.ambientia.net
www.knowit.fi
10/6/2015 © Copyright Knowit Oy 2014 | Confidential | Version 1.08
Problem
Description
www.knowit.fi
PROCOUNTOR NEED
• Procountor is a rapidly growing firm
• New people are hired constantly
• Testing tool and processes need to be updated to meet the new demands
• Knowit was asked to enhance Procountor testing
6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.09 www.knowit.fi
TEST PROCESS ANALYSIS
Knowit test process analysis for Procountor
Means of analysis were:
• Workshops
• Interviews
Two weeks after the release development teams are very busy on fixing bugs. Why?
• Too tight schedule
• Fixed content
• Not enough time for regression testing
6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.010 www.knowit.fi
TEST PROCESS ANALYSIS CONCLUSION
Insufficient regression testing time ->
Whole team approach should be introduced ->
Testing tasks are in the different testing tool ->
Better tool to enforce task sharing ->
Jira ensures already a common way of working ->
Test tool Zephyr was chosen to be used in regression testing
because of seamless integration to Jira among other things
6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.011 www.knowit.fi
© Copyright Knowit Oy 2014 | Confidential | Version 1.012
Introducing
the Test Tool
www.knowit.fi
TEST TOOL DEPLOYMENT PRINCIPLES
Fail fast
• If tool is not suited for you, don’t waste your time, look other way
Start light
• Put only necessary test data in to system in pilot phase
• Do only minimum tweaking to the tool at the beginning
Embrace the change
• Give tool a chance
6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.013 www.knowit.fi
www.knowit.fi
Enhanced
Quality
and
Effectivity
Create a usage model for test tool
Test tool in pilot use for regression testing
Usage model tweaking
Test tool in use for wider testing
Test tool in use internationally
Continuous improvement activities
Integrations to other systems
Test tool used through organization if Finland
Virtualization & automation
GENERAL ABOUT ZEPHYR
• Brings test management and execution functionalities to Jira
New issue type Test
• Possibility to have as an add on for Jira or as an own product
• First Version released in the beginning of 2012
• Latest version 2.6.0 Released on 09.2015
Characteristics
• Easy to use for Jira users
• Customizable
• No test case version control
• If lots of add-on’s are in use the update process of Jira and Zephyr becomes challenging
• No folder structure
6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.015 www.knowit.fi
THINGS TO DO BEFORE DEPLOYMENT 1/3
• Fields for tests must be agreed
• default fields can be used at start
• Screens must be agreed
• Tests workflow should be done when testing process with the new tool is mature enough
• User groups and rights should be put in order
• For example who can modify test executions should be restricted
• Procountor has one tester per group so there is no need to restrict user rights
6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.016 www.knowit.fi
THINGS TO DO BEFORE DEPLOYMENT 2/3
Labels must be decided
• Label is users self chosen tag for tests
• Labels should be agreed so that their amount would not explode
• Labels could be for example: Functional testing, Regression testing, Usability, Load…
6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.017 www.knowit.fi
THINGS TO DO BEFORE DEPLOYMENT 3/3
Components must be decided
• Components are user defined parts of software
• For example: Accounting, User Management, Billing..
6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.018 www.knowit.fi
TEST STATUSES
One part of test process definition is specifying test statuses
• Statuses can be modified based on test process
Default test statuses of Zephyr are
• PASS
• FAIL
• WIP
• BLOCKED
• UNEXECUTED
6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.019 www.knowit.fi
LINKING TESTS TO USER STORIES
Tests can be linked to User Stories
• “Is blocked by” -link statuses are NOT affecting if the test can be run or not
Linking should be done always so changes in User Story can be followed easily
• Changes in user story are NOT sending signal for re-testing
6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.020 www.knowit.fi
TEST CASE DIVISION
1. By Project
• Project is a way to division test cases in a very high level. Procountor has only one Project
2. By Version
• Fix Versions –field can be used to division tests. Test Summary Screen shows tests by version
automatically
3. By Component
• Test can be attached to a component (multivalue field.) Test Summary shows also these.
4. By Label
• Anyone can create new labels so this should be agreed in organization to keep it controlled
6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.021 www.knowit.fi
CYCLES – TEST ROUNDS
Tests are executed in Cycles and one test can be in many Cycle
Tests can be taken to test Cycles either by:
• One at a time
• By Filter
• By Component
• By Label
6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.022 www.knowit.fi
NAMING AND DIVISION OF CYCLES
Cycle name should present their division and support reporting.
Cycle names can be for example:
• Regression test for version xx (Procountor)
• Sprint
• Week
• Tester
• Group
• Combination of above
…
6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.023 www.knowit.fi
© Copyright Knowit Oy 2014 | Confidential | Version 1.024
Monitoring
Test Tool
Deployment
Success
www.knowit.fi
TEST TOOL CONCEPT OWNER
Someone from the organization should be named as a
test tool concept owner after the test tool deployment
Test tool concept owner tasks:
• Follow test tool efficiency continuously
• Follow test tool development roadmap
• Introduce new test tool features to organization
• Gather user requests for test tool customization and integrations
6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.025 www.knowit.fi
MEASURING OF TEST TOOL EFFICIENCY
Test tool efficiency should be followed in during the long period of time
Has the quality of the product enhanced?
• Number of bugs found in production
• Customer satisfaction
Has the efficiency increased?
• Is the tool really used?
• What is the gut feeling? Has the tool helped testing? Is regression testing easier now?
• How wide has the tool usage spread?
• Has the hurry after the release decreased?
• What is the usability of the tool?
6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.026 www.knowit.fi
FUTURE SCENARIO FOR PROCOUNTOR
Testing during development could be done with exploratory testing
• Link exploratory testing session to User Story
• Leaves a trail what has been already tested
6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.027
• Actor: intended user of the system
• Purpose: the theme of the charter including what particular objective the actor wants to
achieve, i.e., the test conditions
• Setup: what needs to be in place in order to start the test execution
• Priority: relative importance of this charter, based on the priority of the associated user story or
the risk level
• Reference: specifications (e.g., user story), risks, or other information sources
• Data: whatever data is needed to carry out the charter
• Activities: a list of ideas of what the actor may want to do with the system and what would be
interesting to test (both positive and negative tests)
• Oracle notes: how to evaluate the product to determine correct results
• Variations: alternative actions and evaluations to complement the ideas described under
activities
www.knowit.fi
EXPLORATORY TESTING – TEST SESSION
6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.028
Session based testing aims to combine accountability and exploratory testing
Test sessions:
• Based on charter
• Uninterrupted session from 60 to 120 minutes
• Evaluation of the functionality or characteristics
• Each session is reported in detail
Test Design
Test Execution
Test Results
Learn Test Charter
Test Session
Test Design
Test Execution
Test Results
Learn Test Charter
Test Session
Test Design
Test Execution
Test Results
Learn Test Charter
Test Session
Session-Based Test Management
www.knowit.fi
TOOLS FOR EXPLORATORY TESTING
Record Steps to Reproduce a Problem
• Windows Out Of the Box tool to take screenshots
• Creates screenshots on each click and typing and creates one file from the recording
• Free in all Windows versions
JIRA Capture
• Web –application to create issues easily
• Records Test Session length, issues and tester notes
• Needs to be purchased
6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.029 www.knowit.fi
THANK YOU!
QUESTIONS?
www.knowit.fi
Knowit Oy
Tehtaankatu 27-29 D
00150 Helsinki
tel. +358 40 3400600
www.knowit.fi
What Test Management challenges and
possibilities are there in the agile/DevOps
model?
www.ambientia.net
Let’s talk!
© Copyright Knowit Oy 2015 | Confidential | Version 1.0www.knowit.fi

More Related Content

What's hot

ISTQB Agile Tester - Agile Test Tools
ISTQB Agile Tester - Agile Test ToolsISTQB Agile Tester - Agile Test Tools
ISTQB Agile Tester - Agile Test Tools
Moataz Nabil
 
Rapise Overview Presentation (2019)
Rapise Overview Presentation (2019)Rapise Overview Presentation (2019)
Rapise Overview Presentation (2019)
Inflectra
 
Scrum Project Management with Jira as showcase
Scrum Project Management with Jira as showcaseScrum Project Management with Jira as showcase
Scrum Project Management with Jira as showcase
javadch
 
Introduction To Jira
Introduction To JiraIntroduction To Jira
Introduction To Jira
Hua Soon Sim
 
KronoDesk Overview Presentation (2019)
KronoDesk Overview Presentation (2019)KronoDesk Overview Presentation (2019)
KronoDesk Overview Presentation (2019)
Inflectra
 
Code in the Cloud - December 8th 2014
Code in the Cloud - December 8th 2014Code in the Cloud - December 8th 2014
Jira Training
Jira TrainingJira Training
Jira Training
Unmesh Ballal
 
Introduction To Jira Slide Share
Introduction To Jira Slide ShareIntroduction To Jira Slide Share
Introduction To Jira Slide Share
Renjith V
 
Jira Basic Concepts
Jira Basic ConceptsJira Basic Concepts
Jira Basic Concepts
MAKSTraining
 
Automation in Jira for beginners
Automation in Jira for beginnersAutomation in Jira for beginners
Automation in Jira for beginners
Elad Ben-Noam
 
Application Lifecycle Management with Visual Studio 2013
Application Lifecycle Management  with Visual Studio 2013Application Lifecycle Management  with Visual Studio 2013
Application Lifecycle Management with Visual Studio 2013
Mahmoud Samara
 
ITIL, Release Management and Automation
ITIL, Release Management and AutomationITIL, Release Management and Automation
ITIL, Release Management and Automation
IBM UrbanCode Products
 
Lights-Out Testing for Lights-On Business
Lights-Out Testing for Lights-On BusinessLights-Out Testing for Lights-On Business
Lights-Out Testing for Lights-On Business
Worksoft
 
DevOps Roadshow - continuous delivery and release management
DevOps Roadshow - continuous delivery and release managementDevOps Roadshow - continuous delivery and release management
DevOps Roadshow - continuous delivery and release management
Microsoft Developer Norway
 
Jira in action
Jira in actionJira in action
Jira in action
Tan Tran
 
A guide for automated testing
A guide for automated testingA guide for automated testing
A guide for automated testing
Moataz Nabil
 
Wikidsmart PM: Requirements Management within Confluence, Integrated with JIRA
Wikidsmart PM: Requirements Management within Confluence, Integrated with JIRAWikidsmart PM: Requirements Management within Confluence, Integrated with JIRA
Wikidsmart PM: Requirements Management within Confluence, Integrated with JIRA
zAgile
 
Jira Agile
Jira AgileJira Agile
Jira Agile
Peter Perger
 
Agile presentation
Agile presentationAgile presentation
Agile presentation
Rahul Chauhan
 
Jira fundamentals
Jira fundamentalsJira fundamentals
Jira fundamentals
Vitaliy Patsay
 

What's hot (20)

ISTQB Agile Tester - Agile Test Tools
ISTQB Agile Tester - Agile Test ToolsISTQB Agile Tester - Agile Test Tools
ISTQB Agile Tester - Agile Test Tools
 
Rapise Overview Presentation (2019)
Rapise Overview Presentation (2019)Rapise Overview Presentation (2019)
Rapise Overview Presentation (2019)
 
Scrum Project Management with Jira as showcase
Scrum Project Management with Jira as showcaseScrum Project Management with Jira as showcase
Scrum Project Management with Jira as showcase
 
Introduction To Jira
Introduction To JiraIntroduction To Jira
Introduction To Jira
 
KronoDesk Overview Presentation (2019)
KronoDesk Overview Presentation (2019)KronoDesk Overview Presentation (2019)
KronoDesk Overview Presentation (2019)
 
Code in the Cloud - December 8th 2014
Code in the Cloud - December 8th 2014Code in the Cloud - December 8th 2014
Code in the Cloud - December 8th 2014
 
Jira Training
Jira TrainingJira Training
Jira Training
 
Introduction To Jira Slide Share
Introduction To Jira Slide ShareIntroduction To Jira Slide Share
Introduction To Jira Slide Share
 
Jira Basic Concepts
Jira Basic ConceptsJira Basic Concepts
Jira Basic Concepts
 
Automation in Jira for beginners
Automation in Jira for beginnersAutomation in Jira for beginners
Automation in Jira for beginners
 
Application Lifecycle Management with Visual Studio 2013
Application Lifecycle Management  with Visual Studio 2013Application Lifecycle Management  with Visual Studio 2013
Application Lifecycle Management with Visual Studio 2013
 
ITIL, Release Management and Automation
ITIL, Release Management and AutomationITIL, Release Management and Automation
ITIL, Release Management and Automation
 
Lights-Out Testing for Lights-On Business
Lights-Out Testing for Lights-On BusinessLights-Out Testing for Lights-On Business
Lights-Out Testing for Lights-On Business
 
DevOps Roadshow - continuous delivery and release management
DevOps Roadshow - continuous delivery and release managementDevOps Roadshow - continuous delivery and release management
DevOps Roadshow - continuous delivery and release management
 
Jira in action
Jira in actionJira in action
Jira in action
 
A guide for automated testing
A guide for automated testingA guide for automated testing
A guide for automated testing
 
Wikidsmart PM: Requirements Management within Confluence, Integrated with JIRA
Wikidsmart PM: Requirements Management within Confluence, Integrated with JIRAWikidsmart PM: Requirements Management within Confluence, Integrated with JIRA
Wikidsmart PM: Requirements Management within Confluence, Integrated with JIRA
 
Jira Agile
Jira AgileJira Agile
Jira Agile
 
Agile presentation
Agile presentationAgile presentation
Agile presentation
 
Jira fundamentals
Jira fundamentalsJira fundamentals
Jira fundamentals
 

Similar to Case Procountor: Zephyr test tool deployment

Exploratory Testing Kari Kakkonen BTD 2017
Exploratory Testing Kari Kakkonen BTD 2017Exploratory Testing Kari Kakkonen BTD 2017
Exploratory Testing Kari Kakkonen BTD 2017
Kari Kakkonen
 
Exploratory Testing Basics and Future Kari Kakkonen Moscow 2018
Exploratory Testing Basics and Future Kari Kakkonen Moscow 2018Exploratory Testing Basics and Future Kari Kakkonen Moscow 2018
Exploratory Testing Basics and Future Kari Kakkonen Moscow 2018
Kari Kakkonen
 
Test Driven Development – What Works And What Doesn’t
Test Driven Development – What Works And What Doesn’t Test Driven Development – What Works And What Doesn’t
Test Driven Development – What Works And What Doesn’t
Synerzip
 
Exploratory Testing - Kari Kakkonen
Exploratory Testing - Kari KakkonenExploratory Testing - Kari Kakkonen
Exploratory Testing - Kari Kakkonen
Kari Kakkonen
 
Exploratory testing Kari Kakkonen KDS2015
Exploratory testing Kari Kakkonen KDS2015Exploratory testing Kari Kakkonen KDS2015
Exploratory testing Kari Kakkonen KDS2015
Kari Kakkonen
 
QA in Digitalized World by Kari Kakkonen at KDS2015
QA in Digitalized World by Kari Kakkonen at KDS2015QA in Digitalized World by Kari Kakkonen at KDS2015
QA in Digitalized World by Kari Kakkonen at KDS2015
Kari Kakkonen
 
Exploratory Testing Basics and Future
Exploratory Testing Basics and FutureExploratory Testing Basics and Future
Exploratory Testing Basics and Future
Kari Kakkonen
 
Ruchika_Mittal_Resume
Ruchika_Mittal_ResumeRuchika_Mittal_Resume
Ruchika_Mittal_Resume
Ruchika Mittal
 
Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle
Kari Kakkonen
 
Kari Kakkonen - Knowit Agile Quality Service
Kari Kakkonen - Knowit Agile Quality ServiceKari Kakkonen - Knowit Agile Quality Service
Kari Kakkonen - Knowit Agile Quality Service
Kari Kakkonen
 
The Challenge of Accepting Software
The Challenge of Accepting SoftwareThe Challenge of Accepting Software
The Challenge of Accepting Software
SQALab
 
QA in Digitalized World Kari Kakkonen WCSQ
QA in Digitalized World Kari Kakkonen WCSQQA in Digitalized World Kari Kakkonen WCSQ
QA in Digitalized World Kari Kakkonen WCSQ
Kari Kakkonen
 
7 steps to Software test automation success
7 steps to Software test automation success7 steps to Software test automation success
7 steps to Software test automation success
ngowda gowda (Looking For New job in Bangalore
 
Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".
Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".
Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".
Emerasoft, solutions to collaborate
 
Archana Joshi Testing in agile is it easier said than done
Archana Joshi Testing in agile   is it easier said than doneArchana Joshi Testing in agile   is it easier said than done
Archana Joshi Testing in agile is it easier said than done
Archana Joshi
 
Testing in agile is it easier said than done
Testing in agile   is it easier said than done Testing in agile   is it easier said than done
Testing in agile is it easier said than done
Archana Joshi
 
Mobile App Quality Roadmap for DevTest Teams
Mobile App Quality Roadmap for DevTest TeamsMobile App Quality Roadmap for DevTest Teams
Mobile App Quality Roadmap for DevTest Teams
Perfecto by Perforce
 
A Utility company in UK leverages Cigniti UAT expertise to reduce defects
A Utility company in UK leverages Cigniti UAT expertise to reduce defectsA Utility company in UK leverages Cigniti UAT expertise to reduce defects
A Utility company in UK leverages Cigniti UAT expertise to reduce defects
ethandoyle
 
QA in digitalized world kari kakkonen ICTexpo2016
QA in digitalized world kari kakkonen  ICTexpo2016QA in digitalized world kari kakkonen  ICTexpo2016
QA in digitalized world kari kakkonen ICTexpo2016
Kari Kakkonen
 
AiTi Education Software Testing Session 02 a
AiTi Education Software Testing Session 02 aAiTi Education Software Testing Session 02 a
AiTi Education Software Testing Session 02 a
AiTi Education
 

Similar to Case Procountor: Zephyr test tool deployment (20)

Exploratory Testing Kari Kakkonen BTD 2017
Exploratory Testing Kari Kakkonen BTD 2017Exploratory Testing Kari Kakkonen BTD 2017
Exploratory Testing Kari Kakkonen BTD 2017
 
Exploratory Testing Basics and Future Kari Kakkonen Moscow 2018
Exploratory Testing Basics and Future Kari Kakkonen Moscow 2018Exploratory Testing Basics and Future Kari Kakkonen Moscow 2018
Exploratory Testing Basics and Future Kari Kakkonen Moscow 2018
 
Test Driven Development – What Works And What Doesn’t
Test Driven Development – What Works And What Doesn’t Test Driven Development – What Works And What Doesn’t
Test Driven Development – What Works And What Doesn’t
 
Exploratory Testing - Kari Kakkonen
Exploratory Testing - Kari KakkonenExploratory Testing - Kari Kakkonen
Exploratory Testing - Kari Kakkonen
 
Exploratory testing Kari Kakkonen KDS2015
Exploratory testing Kari Kakkonen KDS2015Exploratory testing Kari Kakkonen KDS2015
Exploratory testing Kari Kakkonen KDS2015
 
QA in Digitalized World by Kari Kakkonen at KDS2015
QA in Digitalized World by Kari Kakkonen at KDS2015QA in Digitalized World by Kari Kakkonen at KDS2015
QA in Digitalized World by Kari Kakkonen at KDS2015
 
Exploratory Testing Basics and Future
Exploratory Testing Basics and FutureExploratory Testing Basics and Future
Exploratory Testing Basics and Future
 
Ruchika_Mittal_Resume
Ruchika_Mittal_ResumeRuchika_Mittal_Resume
Ruchika_Mittal_Resume
 
Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle Agile Testing – embedding testing into agile software development lifecycle
Agile Testing – embedding testing into agile software development lifecycle
 
Kari Kakkonen - Knowit Agile Quality Service
Kari Kakkonen - Knowit Agile Quality ServiceKari Kakkonen - Knowit Agile Quality Service
Kari Kakkonen - Knowit Agile Quality Service
 
The Challenge of Accepting Software
The Challenge of Accepting SoftwareThe Challenge of Accepting Software
The Challenge of Accepting Software
 
QA in Digitalized World Kari Kakkonen WCSQ
QA in Digitalized World Kari Kakkonen WCSQQA in Digitalized World Kari Kakkonen WCSQ
QA in Digitalized World Kari Kakkonen WCSQ
 
7 steps to Software test automation success
7 steps to Software test automation success7 steps to Software test automation success
7 steps to Software test automation success
 
Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".
Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".
Webinar: "5 semplici passi per migliorare la Quality e i processi di Test".
 
Archana Joshi Testing in agile is it easier said than done
Archana Joshi Testing in agile   is it easier said than doneArchana Joshi Testing in agile   is it easier said than done
Archana Joshi Testing in agile is it easier said than done
 
Testing in agile is it easier said than done
Testing in agile   is it easier said than done Testing in agile   is it easier said than done
Testing in agile is it easier said than done
 
Mobile App Quality Roadmap for DevTest Teams
Mobile App Quality Roadmap for DevTest TeamsMobile App Quality Roadmap for DevTest Teams
Mobile App Quality Roadmap for DevTest Teams
 
A Utility company in UK leverages Cigniti UAT expertise to reduce defects
A Utility company in UK leverages Cigniti UAT expertise to reduce defectsA Utility company in UK leverages Cigniti UAT expertise to reduce defects
A Utility company in UK leverages Cigniti UAT expertise to reduce defects
 
QA in digitalized world kari kakkonen ICTexpo2016
QA in digitalized world kari kakkonen  ICTexpo2016QA in digitalized world kari kakkonen  ICTexpo2016
QA in digitalized world kari kakkonen ICTexpo2016
 
AiTi Education Software Testing Session 02 a
AiTi Education Software Testing Session 02 aAiTi Education Software Testing Session 02 a
AiTi Education Software Testing Session 02 a
 

More from Ambientia

Itms atlassian way-final-2017-10
Itms atlassian way-final-2017-10Itms atlassian way-final-2017-10
Itms atlassian way-final-2017-10
Ambientia
 
Dev ops atlassianway-final-2017-10
Dev ops atlassianway-final-2017-10Dev ops atlassianway-final-2017-10
Dev ops atlassianway-final-2017-10
Ambientia
 
Insight Asset Management for JIRA Service Desk
Insight Asset Management for JIRA Service DeskInsight Asset Management for JIRA Service Desk
Insight Asset Management for JIRA Service Desk
Ambientia
 
APIen hallinnalla uutta liiketoimintaa
APIen hallinnalla uutta liiketoimintaaAPIen hallinnalla uutta liiketoimintaa
APIen hallinnalla uutta liiketoimintaa
Ambientia
 
Miten API management toimii
Miten API management toimiiMiten API management toimii
Miten API management toimii
Ambientia
 
Tunnistamalla asiakaspolut tehostat asiakaspalvelusi toimintaa
Tunnistamalla asiakaspolut tehostat asiakaspalvelusi toimintaaTunnistamalla asiakaspolut tehostat asiakaspalvelusi toimintaa
Tunnistamalla asiakaspolut tehostat asiakaspalvelusi toimintaa
Ambientia
 
OpenShift-webinaari 31.1. / Ambientian esitykset
OpenShift-webinaari 31.1. / Ambientian esityksetOpenShift-webinaari 31.1. / Ambientian esitykset
OpenShift-webinaari 31.1. / Ambientian esitykset
Ambientia
 
ITSM & JIRA Service Desk
ITSM & JIRA Service DeskITSM & JIRA Service Desk
ITSM & JIRA Service Desk
Ambientia
 
Ambientia Service Design -työpaja SYTYKE
Ambientia Service Design -työpaja SYTYKEAmbientia Service Design -työpaja SYTYKE
Ambientia Service Design -työpaja SYTYKE
Ambientia
 
Liferayn rooli Valtorin palveluvalikoimassa
Liferayn rooli Valtorin palveluvalikoimassaLiferayn rooli Valtorin palveluvalikoimassa
Liferayn rooli Valtorin palveluvalikoimassa
Ambientia
 
Digitaalinen asiakaskokemus ja palvelumuotoilu
Digitaalinen asiakaskokemus ja palvelumuotoiluDigitaalinen asiakaskokemus ja palvelumuotoilu
Digitaalinen asiakaskokemus ja palvelumuotoilu
Ambientia
 
Liferay Audience Targeting
Liferay Audience TargetingLiferay Audience Targeting
Liferay Audience Targeting
Ambientia
 
JIRA Portfolio
JIRA PortfolioJIRA Portfolio
JIRA Portfolio
Ambientia
 
Case Containerships JIRA Service Desk
Case Containerships JIRA Service DeskCase Containerships JIRA Service Desk
Case Containerships JIRA Service Desk
Ambientia
 
Jira 7
Jira 7Jira 7
Jira 7
Ambientia
 
Liferay Road Show Sosiaali- ja terveysministeriö
Liferay Road Show Sosiaali- ja terveysministeriöLiferay Road Show Sosiaali- ja terveysministeriö
Liferay Road Show Sosiaali- ja terveysministeriö
Ambientia
 
Liferay Road Show Responsiivinen suunnittelu
Liferay Road Show Responsiivinen suunnitteluLiferay Road Show Responsiivinen suunnittelu
Liferay Road Show Responsiivinen suunnittelu
Ambientia
 
Liferay Road Show Linnunmaa LEX
 Liferay Road Show Linnunmaa LEX Liferay Road Show Linnunmaa LEX
Liferay Road Show Linnunmaa LEX
Ambientia
 
Liferay Road Show Rolf van der Steen
Liferay Road Show Rolf van der SteenLiferay Road Show Rolf van der Steen
Liferay Road Show Rolf van der Steen
Ambientia
 
MehilLisää surinaa intraan case mehiläinen, tuomo vanhanen @ intranetwork 2...
MehilLisää surinaa intraan   case mehiläinen, tuomo vanhanen @ intranetwork 2...MehilLisää surinaa intraan   case mehiläinen, tuomo vanhanen @ intranetwork 2...
MehilLisää surinaa intraan case mehiläinen, tuomo vanhanen @ intranetwork 2...
Ambientia
 

More from Ambientia (20)

Itms atlassian way-final-2017-10
Itms atlassian way-final-2017-10Itms atlassian way-final-2017-10
Itms atlassian way-final-2017-10
 
Dev ops atlassianway-final-2017-10
Dev ops atlassianway-final-2017-10Dev ops atlassianway-final-2017-10
Dev ops atlassianway-final-2017-10
 
Insight Asset Management for JIRA Service Desk
Insight Asset Management for JIRA Service DeskInsight Asset Management for JIRA Service Desk
Insight Asset Management for JIRA Service Desk
 
APIen hallinnalla uutta liiketoimintaa
APIen hallinnalla uutta liiketoimintaaAPIen hallinnalla uutta liiketoimintaa
APIen hallinnalla uutta liiketoimintaa
 
Miten API management toimii
Miten API management toimiiMiten API management toimii
Miten API management toimii
 
Tunnistamalla asiakaspolut tehostat asiakaspalvelusi toimintaa
Tunnistamalla asiakaspolut tehostat asiakaspalvelusi toimintaaTunnistamalla asiakaspolut tehostat asiakaspalvelusi toimintaa
Tunnistamalla asiakaspolut tehostat asiakaspalvelusi toimintaa
 
OpenShift-webinaari 31.1. / Ambientian esitykset
OpenShift-webinaari 31.1. / Ambientian esityksetOpenShift-webinaari 31.1. / Ambientian esitykset
OpenShift-webinaari 31.1. / Ambientian esitykset
 
ITSM & JIRA Service Desk
ITSM & JIRA Service DeskITSM & JIRA Service Desk
ITSM & JIRA Service Desk
 
Ambientia Service Design -työpaja SYTYKE
Ambientia Service Design -työpaja SYTYKEAmbientia Service Design -työpaja SYTYKE
Ambientia Service Design -työpaja SYTYKE
 
Liferayn rooli Valtorin palveluvalikoimassa
Liferayn rooli Valtorin palveluvalikoimassaLiferayn rooli Valtorin palveluvalikoimassa
Liferayn rooli Valtorin palveluvalikoimassa
 
Digitaalinen asiakaskokemus ja palvelumuotoilu
Digitaalinen asiakaskokemus ja palvelumuotoiluDigitaalinen asiakaskokemus ja palvelumuotoilu
Digitaalinen asiakaskokemus ja palvelumuotoilu
 
Liferay Audience Targeting
Liferay Audience TargetingLiferay Audience Targeting
Liferay Audience Targeting
 
JIRA Portfolio
JIRA PortfolioJIRA Portfolio
JIRA Portfolio
 
Case Containerships JIRA Service Desk
Case Containerships JIRA Service DeskCase Containerships JIRA Service Desk
Case Containerships JIRA Service Desk
 
Jira 7
Jira 7Jira 7
Jira 7
 
Liferay Road Show Sosiaali- ja terveysministeriö
Liferay Road Show Sosiaali- ja terveysministeriöLiferay Road Show Sosiaali- ja terveysministeriö
Liferay Road Show Sosiaali- ja terveysministeriö
 
Liferay Road Show Responsiivinen suunnittelu
Liferay Road Show Responsiivinen suunnitteluLiferay Road Show Responsiivinen suunnittelu
Liferay Road Show Responsiivinen suunnittelu
 
Liferay Road Show Linnunmaa LEX
 Liferay Road Show Linnunmaa LEX Liferay Road Show Linnunmaa LEX
Liferay Road Show Linnunmaa LEX
 
Liferay Road Show Rolf van der Steen
Liferay Road Show Rolf van der SteenLiferay Road Show Rolf van der Steen
Liferay Road Show Rolf van der Steen
 
MehilLisää surinaa intraan case mehiläinen, tuomo vanhanen @ intranetwork 2...
MehilLisää surinaa intraan   case mehiläinen, tuomo vanhanen @ intranetwork 2...MehilLisää surinaa intraan   case mehiläinen, tuomo vanhanen @ intranetwork 2...
MehilLisää surinaa intraan case mehiläinen, tuomo vanhanen @ intranetwork 2...
 

Recently uploaded

Introduction-to-the-IAM-Platform-Implementation-Plan.pptx
Introduction-to-the-IAM-Platform-Implementation-Plan.pptxIntroduction-to-the-IAM-Platform-Implementation-Plan.pptx
Introduction-to-the-IAM-Platform-Implementation-Plan.pptx
313mohammedarshad
 
EuroPython 2024 - Streamlining Testing in a Large Python Codebase
EuroPython 2024 - Streamlining Testing in a Large Python CodebaseEuroPython 2024 - Streamlining Testing in a Large Python Codebase
EuroPython 2024 - Streamlining Testing in a Large Python Codebase
Jimmy Lai
 
BLOCKCHAIN TECHNOLOGY - Advantages and Disadvantages
BLOCKCHAIN TECHNOLOGY - Advantages and DisadvantagesBLOCKCHAIN TECHNOLOGY - Advantages and Disadvantages
BLOCKCHAIN TECHNOLOGY - Advantages and Disadvantages
SAI KAILASH R
 
Types of Weaving loom machine & it's technology
Types of Weaving loom machine & it's technologyTypes of Weaving loom machine & it's technology
Types of Weaving loom machine & it's technology
ldtexsolbl
 
WhatsApp Spy Online Trackers and Monitoring Apps
WhatsApp Spy Online Trackers and Monitoring AppsWhatsApp Spy Online Trackers and Monitoring Apps
WhatsApp Spy Online Trackers and Monitoring Apps
HackersList
 
Google I/O Extended Harare Merged Slides
Google I/O Extended Harare Merged SlidesGoogle I/O Extended Harare Merged Slides
Google I/O Extended Harare Merged Slides
Google Developer Group - Harare
 
July Patch Tuesday
July Patch TuesdayJuly Patch Tuesday
July Patch Tuesday
Ivanti
 
Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)
Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)
Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)
Muhammad Ali
 
How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
Adam Dunkels
 
The importance of Quality Assurance for ICT Standardization
The importance of Quality Assurance for ICT StandardizationThe importance of Quality Assurance for ICT Standardization
The importance of Quality Assurance for ICT Standardization
Axel Rennoch
 
Salesforce AI & Einstein Copilot Workshop
Salesforce AI & Einstein Copilot WorkshopSalesforce AI & Einstein Copilot Workshop
Salesforce AI & Einstein Copilot Workshop
CEPTES Software Inc
 
IPLOOK Remote-Sensing Satellite Solution
IPLOOK Remote-Sensing Satellite SolutionIPLOOK Remote-Sensing Satellite Solution
IPLOOK Remote-Sensing Satellite Solution
IPLOOK Networks
 
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
Kief Morris
 
Vertex AI Agent Builder - GDG Alicante - Julio 2024
Vertex AI Agent Builder - GDG Alicante - Julio 2024Vertex AI Agent Builder - GDG Alicante - Julio 2024
Vertex AI Agent Builder - GDG Alicante - Julio 2024
Nicolás Lopéz
 
Best Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdfBest Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdf
Tatiana Al-Chueyr
 
High Profile Girls Call ServiCe Hyderabad 0000000000 Tanisha Best High Class ...
High Profile Girls Call ServiCe Hyderabad 0000000000 Tanisha Best High Class ...High Profile Girls Call ServiCe Hyderabad 0000000000 Tanisha Best High Class ...
High Profile Girls Call ServiCe Hyderabad 0000000000 Tanisha Best High Class ...
aslasdfmkhan4750
 
“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Usef...
“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Usef...“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Usef...
“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Usef...
Edge AI and Vision Alliance
 
Feature sql server terbaru performance.pptx
Feature sql server terbaru performance.pptxFeature sql server terbaru performance.pptx
Feature sql server terbaru performance.pptx
ssuser1915fe1
 
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyyActive Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
RaminGhanbari2
 
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptxDublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Kunal Gupta
 

Recently uploaded (20)

Introduction-to-the-IAM-Platform-Implementation-Plan.pptx
Introduction-to-the-IAM-Platform-Implementation-Plan.pptxIntroduction-to-the-IAM-Platform-Implementation-Plan.pptx
Introduction-to-the-IAM-Platform-Implementation-Plan.pptx
 
EuroPython 2024 - Streamlining Testing in a Large Python Codebase
EuroPython 2024 - Streamlining Testing in a Large Python CodebaseEuroPython 2024 - Streamlining Testing in a Large Python Codebase
EuroPython 2024 - Streamlining Testing in a Large Python Codebase
 
BLOCKCHAIN TECHNOLOGY - Advantages and Disadvantages
BLOCKCHAIN TECHNOLOGY - Advantages and DisadvantagesBLOCKCHAIN TECHNOLOGY - Advantages and Disadvantages
BLOCKCHAIN TECHNOLOGY - Advantages and Disadvantages
 
Types of Weaving loom machine & it's technology
Types of Weaving loom machine & it's technologyTypes of Weaving loom machine & it's technology
Types of Weaving loom machine & it's technology
 
WhatsApp Spy Online Trackers and Monitoring Apps
WhatsApp Spy Online Trackers and Monitoring AppsWhatsApp Spy Online Trackers and Monitoring Apps
WhatsApp Spy Online Trackers and Monitoring Apps
 
Google I/O Extended Harare Merged Slides
Google I/O Extended Harare Merged SlidesGoogle I/O Extended Harare Merged Slides
Google I/O Extended Harare Merged Slides
 
July Patch Tuesday
July Patch TuesdayJuly Patch Tuesday
July Patch Tuesday
 
Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)
Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)
Litestack talk at Brighton 2024 (Unleashing the power of SQLite for Ruby apps)
 
How to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptxHow to Build a Profitable IoT Product.pptx
How to Build a Profitable IoT Product.pptx
 
The importance of Quality Assurance for ICT Standardization
The importance of Quality Assurance for ICT StandardizationThe importance of Quality Assurance for ICT Standardization
The importance of Quality Assurance for ICT Standardization
 
Salesforce AI & Einstein Copilot Workshop
Salesforce AI & Einstein Copilot WorkshopSalesforce AI & Einstein Copilot Workshop
Salesforce AI & Einstein Copilot Workshop
 
IPLOOK Remote-Sensing Satellite Solution
IPLOOK Remote-Sensing Satellite SolutionIPLOOK Remote-Sensing Satellite Solution
IPLOOK Remote-Sensing Satellite Solution
 
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
[Talk] Moving Beyond Spaghetti Infrastructure [AOTB] 2024-07-04.pdf
 
Vertex AI Agent Builder - GDG Alicante - Julio 2024
Vertex AI Agent Builder - GDG Alicante - Julio 2024Vertex AI Agent Builder - GDG Alicante - Julio 2024
Vertex AI Agent Builder - GDG Alicante - Julio 2024
 
Best Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdfBest Practices for Effectively Running dbt in Airflow.pdf
Best Practices for Effectively Running dbt in Airflow.pdf
 
High Profile Girls Call ServiCe Hyderabad 0000000000 Tanisha Best High Class ...
High Profile Girls Call ServiCe Hyderabad 0000000000 Tanisha Best High Class ...High Profile Girls Call ServiCe Hyderabad 0000000000 Tanisha Best High Class ...
High Profile Girls Call ServiCe Hyderabad 0000000000 Tanisha Best High Class ...
 
“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Usef...
“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Usef...“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Usef...
“Deploying Large Language Models on a Raspberry Pi,” a Presentation from Usef...
 
Feature sql server terbaru performance.pptx
Feature sql server terbaru performance.pptxFeature sql server terbaru performance.pptx
Feature sql server terbaru performance.pptx
 
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyyActive Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
Active Inference is a veryyyyyyyyyyyyyyyyyyyyyyyy
 
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptxDublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
Dublin_mulesoft_meetup_Mulesoft_Salesforce_Integration (1).pptx
 

Case Procountor: Zephyr test tool deployment

  • 2. Zephyr Test Tool Deployment | Procountor Knowit Oy, Jussi Rautio 6.10.2015 PAGE 2 [CONFIDENTIAL] THIS IS KNOWIT6.10.2015 www.knowit.fi
  • 3. 6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.03 Senior Quality Consultant, Service Productization Responsible, Service Manager, Test Tool Technical support, Test Tool Deployments and Migrations… • Speaks, train, coach and mentor about • How to take new testing tool in use and best practices. • User trainings for testers, test managers, product owners and quality managers • Metrics and KPI`s benchmarking and design • Data Quality • Process enhancements • Etc. JUSSI RAUTIO, KNOWIT www.knowit.fi
  • 4. KNOWIT Scandinavian company that is listed on Nordic Exchange Stockholm Knowit offering in Finland: • Test and quality management • Solutions for digital business and information management • Development and maintenance of client- specific applications 6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.04 www.knowit.fi
  • 6. • Leading provider of cloud accounting software • Used by over 10 000 companies and over 400 accounting offices • Available in Finland, Norway, Sweden and Denmark 02.09.15 [CONFIDENTIAL] THIS IS KNOWITPAGE 6
  • 7. PROCOUNTOR ATLASSIAN ENVIRONMENT 6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.07 Crowd JIRA FisheyeConfluence Refinedwiki JIRAagile ZephyrforJIRA Timesheetreports Crucible Confluence • Social Intranet • Knowledge Management JIRA • Requirement management • Product development (scrum) • Test management Fisheye/Crucible • Source code browsing • Code review Crowd • User management *500 *50*100*250 Hosted by: www.ambientia.net www.knowit.fi
  • 8. 10/6/2015 © Copyright Knowit Oy 2014 | Confidential | Version 1.08 Problem Description www.knowit.fi
  • 9. PROCOUNTOR NEED • Procountor is a rapidly growing firm • New people are hired constantly • Testing tool and processes need to be updated to meet the new demands • Knowit was asked to enhance Procountor testing 6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.09 www.knowit.fi
  • 10. TEST PROCESS ANALYSIS Knowit test process analysis for Procountor Means of analysis were: • Workshops • Interviews Two weeks after the release development teams are very busy on fixing bugs. Why? • Too tight schedule • Fixed content • Not enough time for regression testing 6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.010 www.knowit.fi
  • 11. TEST PROCESS ANALYSIS CONCLUSION Insufficient regression testing time -> Whole team approach should be introduced -> Testing tasks are in the different testing tool -> Better tool to enforce task sharing -> Jira ensures already a common way of working -> Test tool Zephyr was chosen to be used in regression testing because of seamless integration to Jira among other things 6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.011 www.knowit.fi
  • 12. © Copyright Knowit Oy 2014 | Confidential | Version 1.012 Introducing the Test Tool www.knowit.fi
  • 13. TEST TOOL DEPLOYMENT PRINCIPLES Fail fast • If tool is not suited for you, don’t waste your time, look other way Start light • Put only necessary test data in to system in pilot phase • Do only minimum tweaking to the tool at the beginning Embrace the change • Give tool a chance 6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.013 www.knowit.fi
  • 14. www.knowit.fi Enhanced Quality and Effectivity Create a usage model for test tool Test tool in pilot use for regression testing Usage model tweaking Test tool in use for wider testing Test tool in use internationally Continuous improvement activities Integrations to other systems Test tool used through organization if Finland Virtualization & automation
  • 15. GENERAL ABOUT ZEPHYR • Brings test management and execution functionalities to Jira New issue type Test • Possibility to have as an add on for Jira or as an own product • First Version released in the beginning of 2012 • Latest version 2.6.0 Released on 09.2015 Characteristics • Easy to use for Jira users • Customizable • No test case version control • If lots of add-on’s are in use the update process of Jira and Zephyr becomes challenging • No folder structure 6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.015 www.knowit.fi
  • 16. THINGS TO DO BEFORE DEPLOYMENT 1/3 • Fields for tests must be agreed • default fields can be used at start • Screens must be agreed • Tests workflow should be done when testing process with the new tool is mature enough • User groups and rights should be put in order • For example who can modify test executions should be restricted • Procountor has one tester per group so there is no need to restrict user rights 6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.016 www.knowit.fi
  • 17. THINGS TO DO BEFORE DEPLOYMENT 2/3 Labels must be decided • Label is users self chosen tag for tests • Labels should be agreed so that their amount would not explode • Labels could be for example: Functional testing, Regression testing, Usability, Load… 6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.017 www.knowit.fi
  • 18. THINGS TO DO BEFORE DEPLOYMENT 3/3 Components must be decided • Components are user defined parts of software • For example: Accounting, User Management, Billing.. 6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.018 www.knowit.fi
  • 19. TEST STATUSES One part of test process definition is specifying test statuses • Statuses can be modified based on test process Default test statuses of Zephyr are • PASS • FAIL • WIP • BLOCKED • UNEXECUTED 6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.019 www.knowit.fi
  • 20. LINKING TESTS TO USER STORIES Tests can be linked to User Stories • “Is blocked by” -link statuses are NOT affecting if the test can be run or not Linking should be done always so changes in User Story can be followed easily • Changes in user story are NOT sending signal for re-testing 6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.020 www.knowit.fi
  • 21. TEST CASE DIVISION 1. By Project • Project is a way to division test cases in a very high level. Procountor has only one Project 2. By Version • Fix Versions –field can be used to division tests. Test Summary Screen shows tests by version automatically 3. By Component • Test can be attached to a component (multivalue field.) Test Summary shows also these. 4. By Label • Anyone can create new labels so this should be agreed in organization to keep it controlled 6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.021 www.knowit.fi
  • 22. CYCLES – TEST ROUNDS Tests are executed in Cycles and one test can be in many Cycle Tests can be taken to test Cycles either by: • One at a time • By Filter • By Component • By Label 6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.022 www.knowit.fi
  • 23. NAMING AND DIVISION OF CYCLES Cycle name should present their division and support reporting. Cycle names can be for example: • Regression test for version xx (Procountor) • Sprint • Week • Tester • Group • Combination of above … 6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.023 www.knowit.fi
  • 24. © Copyright Knowit Oy 2014 | Confidential | Version 1.024 Monitoring Test Tool Deployment Success www.knowit.fi
  • 25. TEST TOOL CONCEPT OWNER Someone from the organization should be named as a test tool concept owner after the test tool deployment Test tool concept owner tasks: • Follow test tool efficiency continuously • Follow test tool development roadmap • Introduce new test tool features to organization • Gather user requests for test tool customization and integrations 6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.025 www.knowit.fi
  • 26. MEASURING OF TEST TOOL EFFICIENCY Test tool efficiency should be followed in during the long period of time Has the quality of the product enhanced? • Number of bugs found in production • Customer satisfaction Has the efficiency increased? • Is the tool really used? • What is the gut feeling? Has the tool helped testing? Is regression testing easier now? • How wide has the tool usage spread? • Has the hurry after the release decreased? • What is the usability of the tool? 6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.026 www.knowit.fi
  • 27. FUTURE SCENARIO FOR PROCOUNTOR Testing during development could be done with exploratory testing • Link exploratory testing session to User Story • Leaves a trail what has been already tested 6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.027 • Actor: intended user of the system • Purpose: the theme of the charter including what particular objective the actor wants to achieve, i.e., the test conditions • Setup: what needs to be in place in order to start the test execution • Priority: relative importance of this charter, based on the priority of the associated user story or the risk level • Reference: specifications (e.g., user story), risks, or other information sources • Data: whatever data is needed to carry out the charter • Activities: a list of ideas of what the actor may want to do with the system and what would be interesting to test (both positive and negative tests) • Oracle notes: how to evaluate the product to determine correct results • Variations: alternative actions and evaluations to complement the ideas described under activities www.knowit.fi
  • 28. EXPLORATORY TESTING – TEST SESSION 6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.028 Session based testing aims to combine accountability and exploratory testing Test sessions: • Based on charter • Uninterrupted session from 60 to 120 minutes • Evaluation of the functionality or characteristics • Each session is reported in detail Test Design Test Execution Test Results Learn Test Charter Test Session Test Design Test Execution Test Results Learn Test Charter Test Session Test Design Test Execution Test Results Learn Test Charter Test Session Session-Based Test Management www.knowit.fi
  • 29. TOOLS FOR EXPLORATORY TESTING Record Steps to Reproduce a Problem • Windows Out Of the Box tool to take screenshots • Creates screenshots on each click and typing and creates one file from the recording • Free in all Windows versions JIRA Capture • Web –application to create issues easily • Records Test Session length, issues and tester notes • Needs to be purchased 6.10.2015 © Copyright Knowit Oy 2015 | Confidential | Version 1.029 www.knowit.fi
  • 31. Knowit Oy Tehtaankatu 27-29 D 00150 Helsinki tel. +358 40 3400600 www.knowit.fi
  • 32. What Test Management challenges and possibilities are there in the agile/DevOps model? www.ambientia.net Let’s talk! © Copyright Knowit Oy 2015 | Confidential | Version 1.0www.knowit.fi