The Democratisation of Testing
What you will get out of this Webinar
Learn how Infuse and Kumoco teamed up to build a Quality Engineering framework where BA’s,
Tester and Developers collaborate to build SIT and E2E testing through Business Process Models
The benefits were
• Test Coverage increased by 50% through automated analysis of BPMN and generation of test
designs into Jira/X-Ray using an inbuilt algorithm
• Speed increased by 80%: The analysis work of 5-testers for 4-weeks was reduced to 2-testers
for 1-week
15x increase in test automation productivity by generating 30-50 automated tests per day vs a
typical 2-4 automated tests per day
• The democratisation of testing by getting business users to use the automation
During this webinar, we will demonstrate the processes and tools in action as well as articulate the
benefits of this approach, and how you can apply this to your programmes
Presenters - Nalin - Infuse
Nalin founded Infuse in Feb 2002 - Infuse celebrated it’s
19th birthday 5-days ago !
Infuse’s mission and vision is to help customers get the
most of out their software. Infuse is focused on
modernising software delivery. Nalin has worked on
hundreds of projects across the globe and has over 21+
years of experience in software engineering delivery.
Nalin has a BSc in Statistics, Computers, Operational
Research and Mathematics and did his postgraduate
studies in Advanced Information Technology.
When not evangelising modern software delivery. Nalin
is married with 2 children living in Central London. He is
also a Rugby coach for Blackheath Rugby Club U11’s.
Presenters - Terry
Terry has more than 30 years in IT and from
developer origins has spent most of his career as a
leader and manager of delivery teams. He has
worked in the UK, USA, Oman, UAE, Scandinavia and
much of Europe in a wide range of industries
including Military, Healthcare, Telecoms, Retail,
Insurance, Banking, and Event Management.
COO and Co-Founder of Kumoco an international
Service Integrator and Transformation partner.
Presenters - James
• In 2017, Curiosity Software launched with technologies
and expertise built on decades of experience.
• We’ve built test data solutions since 1995, when our
MD founded the first of 5 pioneering vendors.
• We specialise in requirements modelling, test data
automation, and model-based testing, and are
launching the first Open Testing Platform.
Customer Business Background
• $300m Start up 5g telco business built
from the ground up
• Constantly evolving business
requirements and business process
modeling
• Complex system architecture
• 10 major vendors to integrate
• Demand from investors and
shareholders to launch on time
Technical Stack and Architecture
• Cloud first modern architecture, with
all sensitive data held on an on-prem
Openstack private cloud.
• Multiple saas products are in use with
a bespoke mobile application.
Digital Platform / Security Gateway / Active Directory
ERP Customer Data Hub
BSS
Payment Portal
Data
Warehouse
Fraud
Management
/ Revenue
Assurance
Data
Analytics /
Campaign
API Gateway
Comms Gateway
Network Domain / Provisioning
Gateway
Comms
Gateway
DMaaP Mediation
Interconnect
Billing
OCS
Paymen
t
Gatewa
y
LEGEND
Zentity
Mobileum
Ericsson 3rd Party
IconX
Openet
Kumoco Netcracker
Digital Platform / Security Gateway / Active Directory
ERP Customer Data Hub
BSS
Payment Portal
Data
Warehouse
Fraud
Management
/ Revenue
Assurance
Data
Analytics /
Campaign
API Gateway
Comms Gateway
Network Domain / Provisioning
Gateway
Comms
Gateway
DMaaP
Mediation
Interconnect
Billing
OCS
Payment
Gateway
LEGEND
Kumoco
Contact
Center
Police
The Challenge
• How do we
• Keeping up-to-date with End-to-End
Testing with changing requirements
• Test Quickly and and maximise the
opportunities in Test Automation
• How do I enable shift left ?
• Complex integration architecture
• 163 items in the Master integration list (and
counting)
Digital Platform / Security Gateway / Active Directory
ERP Customer Data Hub
BSS
Payment Portal
Data
Warehouse
Fraud
Management
/ Revenue
Assurance
Data
Analytics /
Campaign
API Gateway
Comms Gateway
Network Domain / Provisioning
Gateway
Comms
Gateway
DMaaP Mediation
Interconnect
Billing
OCS
Paymen
t
Gatewa
y
LEGEND
Zentity
Mobileum
Ericsson 3rd Party
IconX
Openet
Kumoco Netcracker
Digital Platform / Security Gateway / Active Directory
ERP Customer Data Hub
BSS
Payment Portal
Data
Warehouse
Fraud
Management
/ Revenue
Assurance
Data
Analytics /
Campaign
API Gateway
Comms Gateway
Network Domain / Provisioning
Gateway
Comms
Gateway
DMaaP
Mediation
Interconnect
Billing
OCS
Payment
Gateway
LEGEND
Kumoco
Contact
Center
Police
The Approach
Modern Software Delivery Architecture
Tools
• Signavio - Business Process Modelling tool
• Modeller - Model based test design tool
• X-Ray Jira - Test Management System
• Confluence - Portal for sharing reports and dashboards
• useMango - Test Automation Tool & Framework
• Jenkins - Scheduling system for Test Automation
Managing End-to-End Testing with changing requirements
• Trust the business has got it
right
• Leverage the BPML as an
engineering artefact
• Generate the Test Designs in
X-Ray and useMango using a
risk based algorithm
Test Quickly
Outputs: Manual Test
✓Areas in red are auto generated
from the Signavio business process
data
✓If the business process changes the
test case can be regenerated
✓Consistent information across all
artefacts
✓Significantly reduce test
maintenance time
Signavio process generates test
design
Maximise the opportunities in Test Automation
✓ Everyone can automate, not
just high-skill, high cost
automation engineers
✓ Significant time-savings
compared to manually scripting
tests – generate test scripts in
one click!
✓ Maintain test scripts in minutes
✓ Automation saves more time
and cost than it requires
How do I enable shift left ?
• True shift left starts with
architecture business process
model design
• Critically modelling requirements
identifies bugs during the design
phase. “Shift left” reduces
remediation costs while avoiding
the time wasted on
miscommunication.
The Democratisation of Testing
Democratisation: Business Users Reuse the automation
Democratisation: Business Users Reuse the automation
Move from building 1-2 automated tests per day to 30-50 automated tests per day
Risk based Testing
● Suggested categories
○ Impact of failure; financial, reputational; operational,
regulatory
○ Probability of failure (based on SIT data): Low, Medium, High
○ Stakeholder impact: Customers, Customers and Business,
Business
This algorithm will be setup in X-Ray based on input from
earlier test phases
Very High
High
Medium
Low
Very Often
Often
Sometimes
Rarely
PROBABILITY OF
FAILURE
FREQUENCY OF USE
1
2
3
4
5
6
7
Demo
Demo
1 – Showing process in Signavio
2 – Importing into Test Modeller
3 – Generating test cases from biz design and pushing to X-Ray and reviewing them
4 – Looping back to model – Introducing and overlaying useMango automation
5 – Test Execution in useMango
6 – What happens when things change?
Benefits
• Test Coverage increased by 50% through automated analysis of BPMN and generation of
test designs into Jira/X-Ray using an inbuilt algorithm
• Speed increased by 80%: The analysis work of 5-testers for 4-weeks was reduced to 2-
testers for 1-week
15x increase in test automation productivity by generating 30-50 automated tests per
day vs a typical 2-4 automated tests per day
• The democratisation of testing by getting business users to use the automation
Any Questions?
What next?
Carry on the conversation
• Try what you’ve seen today - head to TestModeller.io and
useMango.co.uk for a free trial
• Book a web meeting with Curiosity or an Infuse expert.
• Get in touch with your questions and feedback
• James.Walker@Curiosity.Software
• Terry@Kumoco.com
• Nalin.Parbhu@Infuse.it
• We’ll email you the slides, webinar recording and a short demo
video. Please share with your friends and colleagues!

Curiosity Software, Infuse and Kumoco present: The Democratisation of Testing

  • 1.
  • 2.
    What you willget out of this Webinar Learn how Infuse and Kumoco teamed up to build a Quality Engineering framework where BA’s, Tester and Developers collaborate to build SIT and E2E testing through Business Process Models The benefits were • Test Coverage increased by 50% through automated analysis of BPMN and generation of test designs into Jira/X-Ray using an inbuilt algorithm • Speed increased by 80%: The analysis work of 5-testers for 4-weeks was reduced to 2-testers for 1-week 15x increase in test automation productivity by generating 30-50 automated tests per day vs a typical 2-4 automated tests per day • The democratisation of testing by getting business users to use the automation During this webinar, we will demonstrate the processes and tools in action as well as articulate the benefits of this approach, and how you can apply this to your programmes
  • 3.
    Presenters - Nalin- Infuse Nalin founded Infuse in Feb 2002 - Infuse celebrated it’s 19th birthday 5-days ago ! Infuse’s mission and vision is to help customers get the most of out their software. Infuse is focused on modernising software delivery. Nalin has worked on hundreds of projects across the globe and has over 21+ years of experience in software engineering delivery. Nalin has a BSc in Statistics, Computers, Operational Research and Mathematics and did his postgraduate studies in Advanced Information Technology. When not evangelising modern software delivery. Nalin is married with 2 children living in Central London. He is also a Rugby coach for Blackheath Rugby Club U11’s.
  • 4.
    Presenters - Terry Terryhas more than 30 years in IT and from developer origins has spent most of his career as a leader and manager of delivery teams. He has worked in the UK, USA, Oman, UAE, Scandinavia and much of Europe in a wide range of industries including Military, Healthcare, Telecoms, Retail, Insurance, Banking, and Event Management. COO and Co-Founder of Kumoco an international Service Integrator and Transformation partner.
  • 5.
    Presenters - James •In 2017, Curiosity Software launched with technologies and expertise built on decades of experience. • We’ve built test data solutions since 1995, when our MD founded the first of 5 pioneering vendors. • We specialise in requirements modelling, test data automation, and model-based testing, and are launching the first Open Testing Platform.
  • 6.
    Customer Business Background •$300m Start up 5g telco business built from the ground up • Constantly evolving business requirements and business process modeling • Complex system architecture • 10 major vendors to integrate • Demand from investors and shareholders to launch on time
  • 7.
    Technical Stack andArchitecture • Cloud first modern architecture, with all sensitive data held on an on-prem Openstack private cloud. • Multiple saas products are in use with a bespoke mobile application. Digital Platform / Security Gateway / Active Directory ERP Customer Data Hub BSS Payment Portal Data Warehouse Fraud Management / Revenue Assurance Data Analytics / Campaign API Gateway Comms Gateway Network Domain / Provisioning Gateway Comms Gateway DMaaP Mediation Interconnect Billing OCS Paymen t Gatewa y LEGEND Zentity Mobileum Ericsson 3rd Party IconX Openet Kumoco Netcracker Digital Platform / Security Gateway / Active Directory ERP Customer Data Hub BSS Payment Portal Data Warehouse Fraud Management / Revenue Assurance Data Analytics / Campaign API Gateway Comms Gateway Network Domain / Provisioning Gateway Comms Gateway DMaaP Mediation Interconnect Billing OCS Payment Gateway LEGEND Kumoco Contact Center Police
  • 8.
    The Challenge • Howdo we • Keeping up-to-date with End-to-End Testing with changing requirements • Test Quickly and and maximise the opportunities in Test Automation • How do I enable shift left ? • Complex integration architecture • 163 items in the Master integration list (and counting) Digital Platform / Security Gateway / Active Directory ERP Customer Data Hub BSS Payment Portal Data Warehouse Fraud Management / Revenue Assurance Data Analytics / Campaign API Gateway Comms Gateway Network Domain / Provisioning Gateway Comms Gateway DMaaP Mediation Interconnect Billing OCS Paymen t Gatewa y LEGEND Zentity Mobileum Ericsson 3rd Party IconX Openet Kumoco Netcracker Digital Platform / Security Gateway / Active Directory ERP Customer Data Hub BSS Payment Portal Data Warehouse Fraud Management / Revenue Assurance Data Analytics / Campaign API Gateway Comms Gateway Network Domain / Provisioning Gateway Comms Gateway DMaaP Mediation Interconnect Billing OCS Payment Gateway LEGEND Kumoco Contact Center Police
  • 9.
  • 10.
  • 11.
    Tools • Signavio -Business Process Modelling tool • Modeller - Model based test design tool • X-Ray Jira - Test Management System • Confluence - Portal for sharing reports and dashboards • useMango - Test Automation Tool & Framework • Jenkins - Scheduling system for Test Automation
  • 12.
    Managing End-to-End Testingwith changing requirements • Trust the business has got it right • Leverage the BPML as an engineering artefact • Generate the Test Designs in X-Ray and useMango using a risk based algorithm
  • 13.
    Test Quickly Outputs: ManualTest ✓Areas in red are auto generated from the Signavio business process data ✓If the business process changes the test case can be regenerated ✓Consistent information across all artefacts ✓Significantly reduce test maintenance time Signavio process generates test design
  • 14.
    Maximise the opportunitiesin Test Automation ✓ Everyone can automate, not just high-skill, high cost automation engineers ✓ Significant time-savings compared to manually scripting tests – generate test scripts in one click! ✓ Maintain test scripts in minutes ✓ Automation saves more time and cost than it requires
  • 15.
    How do Ienable shift left ? • True shift left starts with architecture business process model design • Critically modelling requirements identifies bugs during the design phase. “Shift left” reduces remediation costs while avoiding the time wasted on miscommunication.
  • 16.
  • 17.
    Democratisation: Business UsersReuse the automation
  • 18.
    Democratisation: Business UsersReuse the automation Move from building 1-2 automated tests per day to 30-50 automated tests per day
  • 19.
    Risk based Testing ●Suggested categories ○ Impact of failure; financial, reputational; operational, regulatory ○ Probability of failure (based on SIT data): Low, Medium, High ○ Stakeholder impact: Customers, Customers and Business, Business This algorithm will be setup in X-Ray based on input from earlier test phases Very High High Medium Low Very Often Often Sometimes Rarely PROBABILITY OF FAILURE FREQUENCY OF USE 1 2 3 4 5 6 7
  • 20.
  • 21.
    Demo 1 – Showingprocess in Signavio 2 – Importing into Test Modeller 3 – Generating test cases from biz design and pushing to X-Ray and reviewing them 4 – Looping back to model – Introducing and overlaying useMango automation 5 – Test Execution in useMango 6 – What happens when things change?
  • 22.
    Benefits • Test Coverageincreased by 50% through automated analysis of BPMN and generation of test designs into Jira/X-Ray using an inbuilt algorithm • Speed increased by 80%: The analysis work of 5-testers for 4-weeks was reduced to 2- testers for 1-week 15x increase in test automation productivity by generating 30-50 automated tests per day vs a typical 2-4 automated tests per day • The democratisation of testing by getting business users to use the automation
  • 23.
  • 24.
  • 25.
    Carry on theconversation • Try what you’ve seen today - head to TestModeller.io and useMango.co.uk for a free trial • Book a web meeting with Curiosity or an Infuse expert. • Get in touch with your questions and feedback • James.Walker@Curiosity.Software • Terry@Kumoco.com • Nalin.Parbhu@Infuse.it • We’ll email you the slides, webinar recording and a short demo video. Please share with your friends and colleagues!