This document discusses test automation beyond just test execution. It introduces model-based testing (MBT) as a potential solution to challenges like tight schedules, low resources, and continuous changes. MBT uses visual models of system behavior to understand all possible scenarios and improve test coverage. It can make the test design process smarter, faster and earlier. MBT frameworks allow requirements analysis, test writing and testing, and maintenance across roles like business analysts, developers and testers. Success requires modeling skills, early adoption, peer reviews, management support, and focusing on concepts before tools. The document advocates integrating MBT with automated testing for maximum benefit.

1. Test Automation Beyond Test
Execution
10 October 2019
Lana Rousakovski
Lead Solution & Test Designer, Lean Six Sigma
Master Black Belt, Cerner

2. Never-ending Testing Challenges
Tight
schedule
Low resources (& cost) Reduce defect leakage /
escaped defects
Continuous
changes

3. Test Automation – Solution To All?
Test Early
?
Test Coverage
?
Time to design tests
or write test scripts
?
Test Planning & Test
Analysis
?

4. Test Automation – Solution To All?
Test Early
?
Test Coverage
?
Time to design tests
or write test scripts
?
Test Planning & Test
Analysis
?

5. Is Test Automation All We Can do?
Test Execution
Test Planning & Test Analysis
Test/Script Writing
Test Maintenance

6. What Is The Secret?
There was a software tester who had an exceptional gift for finding bugs…

7. Can MBT Be The Answer?
Makes testing SMARTer
Simplifies the complex process of
test analysis & design
Focuses on accurate tests at the
right time
MBT
MBT+
Automation
Exponentially increases coverage
with minimal additional effort
Faster test automation

8. Why MBT?
Visually model
system
behavior
Understand all
possible
scenarios
Evaluate and
select test
coverage
Improve test coverage
Make test design process smarter, faster and earlier
Automate elements of test design & test writing
plus

9. Models &
Approaches
@Henna Sheynblyum

10. MBT Framework: Testing And Beyond
Requirements
Analysis
Planning &
Inception
Implementation
& Maintenance
Design &
Development
Test Writing
&Testing
Business Analysts/ Developers/ Testers visualize system
workflows, collaborate, and develop mutual understanding.
Business Analysts & Product Owners use model for
customer validations
All roles collaborate on model/details,
remove ambiguities & gaps.
Business & UX Analysts use model for
usability reviews.
Business Analysts use models for user
story mapping
Testers start generating high level tests
(system level).
Developers may use model for validation of design
against requirements.
Business Analysts & Testers continue to refine
model and make final adjustments .
Testers re-generate updated tests.
Automation Engineer & Testers work on automating
flows.
Technical Writers may use models to start writing
user documentations.
Testers generate tests for manual
and automated test execution.
Testers incorporate test execution
results back into model for future
RBT analysis.
Business Analysts/ Developers/
Testers use models for RBT analysis
for business impact
Business Analysts &
Testers incorporate
escaped defects into the
model & re-generate
updated tests.
Business Analysts/
Developers/ Testers apply
algorithms for test scope
selection for release
updates.
All roles use model for
root-cause analysis.

11. Visualization, Collaboration &
Communication
• Encourages collaboration across
all roles – Product Owners,
Business Analysts, Developers,
Test Analysts
• All roles reach agreement earlier
in the development cycle (e.g.,
defining user journeys)
• Shared understanding – visual is
the key
• “Talk” to your team. Use model as
a tool to facilitate the
communication.

12. • Peer & team reviews
• Part of the standard process
Our Experience with Industry MBT Myths
• Adds to traditional test design
techniques and practices doesn’t
replace them
• Test design standards
• Examples & reference materials
• Stay at user level
• MBT impacts the whole test process
• A MUST: strong support from management to lead the
process and tool changes in the organization.
• Focus on the concept before focusing on the tool
• Modeling skills are very critical
• Support from all roles
• This is one of the major perception challenges
• New way of thinking – do not fit into “existing box”
• Good training, examples, reference materials
• Drivers and experts from all roles
• Apply Test Case generation strategies & algorithms;
intelligent filtering
• BEST: Integrate MBT framework with automated testing
MBT always
correct
MBT solves
all the
problems
MBT will
cause tests
explosion
MBT is just
tooling

13. From MBT to AI:
Integrating MBT with Automated Testing

14. Success Factors
Modeling skills
are very critical!
Early start &
peer reviews
Part of the
standard
process
New way of
thinking – do not
try to fit into
“existing box”
Good test
design
standards
Good training,
examples and
reference
material
Focus on the
concept before
focusing on the
tool
Management
support
Support from
all roles

15. Modeling & Test Automation in
Action
@Henna Sheynblyum,

16. Modeling & Test Automation in
Action #2
@Henna Sheynblyum

17. Questions?