How to industrialize software testing

with Model Driven Testing and ModelDT tooling
About Model Drivers

Business model industrialization.
Model driven products and services:
• Reporting
• Testing
• Regulat...
Agenda

A.
B.
C.
D.

The testing landscape and its gaps
Steps to industrialized testing
How to tool up for industrialized ...
A: The testing landscape and its gaps

The development process is putting testing up the front
There are many tools suppor...
The development process is putting testing up the front

•

•

In the agile,
Behaviour Driven
Development,
continuous deli...
There are many tools supporting the testing domain

MS Excel
everywhere!

•

•

•

Testing is
supported by
many tools
It h...
But there is a problem

The tools do not talk
to each other
User Acceptance
Risk
Test plan
Test
management

Test case

Tes...
B: Steps to industrialised testing

1. Adopt the vision and mental model
2. Implement four big ideas
3. Continuous learnin...
1. Adopting the vision

What good testing looks like
Tests are 100% aligned to the
requirements
(even when things change)
...
The model driven testing mental model

1: Separation of concerns, with each
concern well managed.
2: Testing analysis and ...
2. Implement four big ideas

•
•
•
•

Big idea 1: Industrialise your understand of your business
Big idea 2: Industrialise...
Step 1: Industrialize your understanding of your business

1.

2.

3.

You cant do a good
job of testing
without a good
un...
Step 2: Industrialise the design of your testing ecosystem

1.

2.

3.
4.

Industrialized testing
can only be built
from a...
..break your analysis and design of testing into manageable packages

The UML
Testing
Profile gives
the testing
industry 6...
Step 3: Overlay your business understanding with your testing requirements

Business domain
Process

Overlay the
testing
s...
Step 4: Drive testing through automation and tooling

MS Excel
everywhere!

MD Word testing
specifications
Continuous test...
C: How to tool up for industrialized testing with ModelDT

Tooling for planning, analysis and design
Example automations w...
Tooling for planning, analysis and design

You get
 Architectural view of
testing
 Large scale automation

Manager
& Arc...
Example automations with ModelDT

a) Harvest and integrate existing knowledge
b) Validation to the testing profile rules
c...
a) Harvest and integrate existing knowledge

Quality Center

You get
 Synthesis
 De-duplication
 Consistency
 Visibili...
b) Validation to the testing profile rules

You get
 Highlights on items in error
 Error messages describing the break
...
c) Analysis tools

Test components: E.g. test case

Business domain – use case and data entities

Coverage of business dom...
d) Auto generate test plans and specifications
You get
 Consistency and quality
 Guaranteed alignment between
business d...
e) Auto generate code that tests your data to the requirements

Class diagram

Data format validations
Schema

Constraints...
f) Auto generate test cases and scripts for test runners
Business data models
Process processes

Messages and
signals

Bus...
g) Synthetic test data generation
You get
 Data with 100% test coverage
 Guaranteed alignment of
business and test data
...
h) Work in familiar Web and Excel for day to day work

RESTful web
service interface

Modelling
interface

Excel
interface...
modelDT plugin development roadmap

1.0
–
–
–
–
–

Base Domain Specific Language
Test Case designs
Business domain coverag...
D: Summary and further reading

Summary
- Testing is supported by many great tools
- But they do not talk to each other
- ...
Next steps

• The UML Testing Profile: Slide presentation
• Demonstration: Attend a short web presentation and explore any...
Upcoming SlideShare
Loading in …5
×

Model drivers how to industrialize testing 2013-09-01b

327 views

Published on

Automation and repeat-ability - these are answers to the high cost of testing and business process conformance.

These slides support a talk on how to structure and tool for testing and conformance industrialization.

Published in: Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
327
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
4
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Model drivers how to industrialize testing 2013-09-01b

  1. 1. How to industrialize software testing with Model Driven Testing and ModelDT tooling
  2. 2. About Model Drivers Business model industrialization. Model driven products and services: • Reporting • Testing • Regulatory conformance • Business strategy and business cases • Business architecture • Systems delivery 2013-09 2 How to industrialize testing
  3. 3. Agenda A. B. C. D. The testing landscape and its gaps Steps to industrialized testing How to tool up for industrialized testing with ModelDT Summary and further reading 2013-09 3 How to industrialize testing
  4. 4. A: The testing landscape and its gaps The development process is putting testing up the front There are many tools supporting the testing domain But there is a problem – the tools don’t talk to each others 2013-09 4 How to industrialize testing
  5. 5. The development process is putting testing up the front • • In the agile, Behaviour Driven Development, continuous delivery paradigms, test design comes before development. … therefore.. testing is even more closely integrate with business requirements User story User Test case Develop Backlog Test result Production 2013-09 5 How to industrialize testing
  6. 6. There are many tools supporting the testing domain MS Excel everywhere! • • • Testing is supported by many tools It has to be because testing's scope is 100% wide Many of the tools are excellent, with long, successful histories and wide adoption MD Testing specifications Continuous testing and integration Quality Center Requirements management, test management Behaviour driven testing Testing environment virtualisation Auto testing of business rules 2013-09 6 The testing profile and its
  7. 7. But there is a problem The tools do not talk to each other User Acceptance Risk Test plan Test management Test case Tester Test result Unit test System Under Test data Test Programmer Database User Operating model / User story Business process Test runner Project manager 2013-09 7 Test environment How to industrialize testing
  8. 8. B: Steps to industrialised testing 1. Adopt the vision and mental model 2. Implement four big ideas 3. Continuous learning and improvement 2013-09 8 How to industrialize testing
  9. 9. 1. Adopting the vision What good testing looks like Tests are 100% aligned to the requirements (even when things change) Guaranteed correct Fast (=automated) Cheap (=automated) Industrialization: Conversion to the methods, aims, and ideals of industry and economic activity, particularly of an area that was previously underdeveloped 2013-09 9 Fully visible – at the tester level Well governed and managed How to industrialize testing
  10. 10. The model driven testing mental model 1: Separation of concerns, with each concern well managed. 2: Testing analysis and design is supported with specific tools. language and designs. Architect Design Build 2013-09 10 How to industrialize testing
  11. 11. 2. Implement four big ideas • • • • Big idea 1: Industrialise your understand of your business Big idea 2: Industrialise the design of your testing ecosystem Big idea 3: Overlay your business understanding with your testing requirements Big idea 4: Drive testing through automation and tooling 2013-09 11 How to industrialize testing
  12. 12. Step 1: Industrialize your understanding of your business 1. 2. 3. You cant do a good job of testing without a good understanding of the requirements To industrialise testing you therefor have to industrialise your understanding of the business domain This means tooling and appropriate language Business process model 2013-09 12 Data model How to industrialize testing
  13. 13. Step 2: Industrialise the design of your testing ecosystem 1. 2. 3. 4. Industrialized testing can only be built from a structured, automated design That requires a specific, specialised language And supporting tooling Within a well specified framework Testing eco-system 2013-09 13 How to industrialize testing
  14. 14. ..break your analysis and design of testing into manageable packages The UML Testing Profile gives the testing industry 6 domains to standardize on Test architecture: Testing meta model, business domain, testing package Test package: System Under Test, test context, test components Test configuration: Test cases, scheduler, arbiters, logs Test case: Testing activity Test data: Data pools, partitions, selectors Deployment: Nodes for SUT, Test components, Scheduler 2013-09 14 How to industrialize
  15. 15. Step 3: Overlay your business understanding with your testing requirements Business domain Process Overlay the testing strategy Testing domain Test strategy Process model Test cases Data Generation Generation Data model Test data 2013-09 15 How to industrialize testing
  16. 16. Step 4: Drive testing through automation and tooling MS Excel everywhere! MD Word testing specifications Continuous testing and integration Business and systems modelling Quality Center Because design information is structured, this interface can be automated 2013-09 16 Requirements management, test management Behaviour driven testing Testing environment virtualisation Auto testing of business rules How to industrialize testing
  17. 17. C: How to tool up for industrialized testing with ModelDT Tooling for planning, analysis and design Example automations with ModelDT 2013-09 17 How to industrialize testing
  18. 18. Tooling for planning, analysis and design You get  Architectural view of testing  Large scale automation Manager & Architect Risk management User Acceptance Test Test plan Test case Tester Unit test SUT Test data Programmer Test result Database User Operating model / Business process User story Project manager 2013-09 18 Test runner Test environment How to industrialize testing
  19. 19. Example automations with ModelDT a) Harvest and integrate existing knowledge b) Validation to the testing profile rules c) Analysis tools d) Auto generate test plans and specifications e) Auto generate code that tests your data to the requirements f) Auto generate test cases and scripts for test runners g) Synthetic test data generation h) Work in familiar Web and Excel for day to day work 2013-09 19 How to industrialize testing
  20. 20. a) Harvest and integrate existing knowledge Quality Center You get  Synthesis  De-duplication  Consistency  Visibility 2013-09 20 How to industrialize testing
  21. 21. b) Validation to the testing profile rules You get  Highlights on items in error  Error messages describing the break  Guaranteed conformance to the UTP rules 2013-09 21 How to industrialize testing
  22. 22. c) Analysis tools Test components: E.g. test case Business domain – use case and data entities Coverage of business domain By testing package You get  Management reports on test coverage  Control reports  Change impact assessments 2013-09 22 How to industrialize testing
  23. 23. d) Auto generate test plans and specifications You get  Consistency and quality  Guaranteed alignment between business domain and tests  Automated specs and designs Deployment plans Test package design Automated test specifications 2013-09 23 How to industrialize testing
  24. 24. e) Auto generate code that tests your data to the requirements Class diagram Data format validations Schema Constraints Business rule validations You get  Automated testing of data format and business rules  Guaranteed alignment between requirements and tests 2013-09 24 The testing profile and its
  25. 25. f) Auto generate test cases and scripts for test runners Business data models Process processes Messages and signals Business processes Quality Center Junit Test scripts Test cases 2013-09 25 Test runners How to industrialize testing
  26. 26. g) Synthetic test data generation You get  Data with 100% test coverage  Guaranteed alignment of business and test data  Test data fast Upload data and business rule definitions ModelDT web service Download comprehensive test data Positive test data Negative test data Business domain models 2013-09 26 How to industrialize testing
  27. 27. h) Work in familiar Web and Excel for day to day work RESTful web service interface Modelling interface Excel interface Database Web interface 2013-09 27 How to industrialize testing
  28. 28. modelDT plugin development roadmap 1.0 – – – – – Base Domain Specific Language Test Case designs Business domain coverage reports Synthetic test data generation End user help, manual, training 1.1 – Extended DSL – Extended analysis reports 2.0 – Test script outputs – Junit, Quality Centre, etc – Methodology wizards – Domain specific patterns and models 3.0 – Risk modelling and management 2013-09 28 The testing profile and its
  29. 29. D: Summary and further reading Summary - Testing is supported by many great tools - But they do not talk to each other - The UML Testing profile is a testing language - ModelDT is a tool that implements the UML Testing Profile - Thus enabling integration and large scale automation 2013-09 29 How to industrialize testing
  30. 30. Next steps • The UML Testing Profile: Slide presentation • Demonstration: Attend a short web presentation and explore any aspect of Model Driven Testing. • White paper: Request a copy of “Roadmap to industrialised testing”. • Questions: Greg Soulsby http://uk.linkedin.com/in/gregsoulsby • Twitter: @modelDT, @modelDrivers • Youtube: modelDrivenTesting • Linked in group: www.linkedin.com/groups/Model-drivers-4341672/ • Blog: http://blog.modeldrivers.us/ • Site: www.modelDrivers.us • Plugin beta: Get the benefits with free support & contribute to direction 2013-09 30 How to industrialize testing

×