SlideShare a Scribd company logo
1 of 17
© Curiosity Software Ireland Ltd. 2023
Isolating blast radiuses for
testing
How to not blow up your DevOps world
Toby Richardson
Test Data Engineer
Toby.Richardson@Curiosity.Software
@CuriositySoft
Rich Jordan
Enterprise Solutions Architect, Curiosity
Rich.Jordan@Curiosity.Software
@RichJordan81
© Curiosity Software 2023
You have a “DevOps” Transformation, but
your Test approach hasn’t really changed
Too many e2e tests
high cost / time to
maintain test assets
10001110101
10101110101
10001010101
10011110101
10001110111
Bloated (regression)
test packs
Accidental complexity
• Combinatorial explosions
• Huge Data requirements
• Huge test environment
requirements
• Large duplication in test
coverage
A Separation between
what is being tested and
how the system actually
works / changes
Too many UI
Tests
DevOps loop. Original Image: Khanargy, Wikimedia Commons, published under CC BY-SA 4.0 license.
© Curiosity Software 2023
Your environment and test data
approach (or lack of)
© vincentdnl Used with permission from the
creator.
© Curiosity Software 2023
The 3 ways of DevOps
The Three Ways: The Principles Underpinning DevOps
by Gene Kim / IT Revolution
https://itrevolution.com/articles/the-three-ways-principles-underpinning-devops/
Original Image: Khanargy, Wikimedia Commons,
published under CC BY-SA 4.0 license.
Flow
• Never passing a known defect to downstream work centers
• Never allowing local optimization to create global degradation
• Always seeking to increase flow
• Always seeking to achieve profound understanding of the system
Amplify Feedback Loops
• Shortening and amplifying all feedback loops
• Embedding knowledge where we need it.
Culture of Continual Experimentation & Learning
• Continual experimentation
• Taking risks and learning from failure
• Understanding that repetition and practice is the prerequisite to mastery
© Curiosity Software 2023
Getting your Test Approach right - Maintain coherence with
product design and established design principles
© Curiosity Software 2023
Shortening and amplifying feedback loops –
modelling for isolation
1) Reinforcing / proving the external boundaries
2) Reinforcing / proving the internal boundaries
3) Proving the systems elements in isolation
4) Proving batch / reporting
5) Proving the golden thread of the platform
6) Stakeholder demonstration
This is more “acceptance” than testing. If testing
focuses here, it will become bloated, and both your
platform and change will become monolithic.
© Curiosity Software 2023
Understanding and visualizing the
flow of data
1. What data flows between systems?
2. What relationships exist between the data
being passed around systems?
I need to understand (or be confident enough about) the
whole before we can set out a strategy to isolate
Tip: The Accidental complexity of “we don’t have time to
do this” will inevitably keep you locked into the big
integration problems you have today – and they will only
get worse the longer you put this off!
Data flowing
Some of its possible
relationships
Demo
© Curiosity Software Ireland Ltd. 2023
© Curiosity Software 2023
Ephemeral environments – Unleash
virtual databases
Persistent environments come hand in hand
with large sets of stagnant test data
That data might even be live data!
Data ages and becomes useless – Get Rid of it!
We are so wasteful when it comes to
duplicated / dormant test infrastructure
Ephemeral = short lived
“Understanding that repetition and practice is
the prerequisite to mastery”
V1, Sprint 4
V1, Sprint 3
V1, Sprint 2
Point-in-time
data dump
V1, Sprint 1
Bugs found New RQMTs
V2, Sprint 2
V2, Sprint 1
Big trouble
“Waterfall” data
provisioning (static dumps)
“Parallel”
teams
One single, static
source of truth
“Ephemeral” environments
• Available in parallel - teams, versions
• Tailored to the blast radius of the
moment
Demo
© Curiosity Software Ireland Ltd. 2023
© Curiosity Software 2023
Stubbing / Sandboxes
We don’t need that e2e environment
In fact, we don’t even need the real interface
But we do need a representation of the interface
And we need data / Reponses to be in different states (stateful)
“Never allowing local optimization to create global degradation”
“Always seeking to increase flow”
“Always seeking to achieve profound understanding of the system”
Constrained
component
Costly
infrastructure
Unfinished
integration
E2E
environment
Complex, costly,
unavailable in parallel
Request
Response
Virtual Service
Stateful
DB
Demo
© Curiosity Software Ireland Ltd. 2023
© Curiosity Software 2023
Linking tests (models) to your data
Whilst I’ve made optimizations to my environment, my data is
still separate from my tests
I still might suffer test >< data drift
Can I link, or better still generate data linked to the tests I want
to run?
Or even create Models / Tests from my data?
“Never passing a known defect to downstream work centers”
Change:
traceability
and risk
analysis
User stories Test
generation
Test Data
Automation
Virtual
Sandboxing
Demo
© Curiosity Software Ireland Ltd. 2023
© Curiosity Software Ireland Ltd. 2023
Questions and Discussion
© Curiosity Software 2023
Carry on the conversation?
• Check out Rich’s February webinar: “Modelling for Continuous
Testing”
• Book a demo and discussion with a Curiosity expert!
• Try Test Modeller. Visit Testmodeller.io for a free trial and online tutorials.
• Follow Curiosity Software on LinkedIn and @CuriositySoft on Twitter for
resources and news.
• Connect with Rich and Toby on LinkedIn.
© Curiosity Software Ireland Ltd. 2023
Thank you
Rich.Jordan@Curiosity.Software
Toby.Richardson@Curiosity.Software

More Related Content

Similar to Curiosity Software Presents: Isolating blast radiuses for testing - How to not blow up your DevOps world

Curiosity and Coforge present - Oracle FLEXCUBE: De-risk upgrades and migrati...
Curiosity and Coforge present - Oracle FLEXCUBE: De-risk upgrades and migrati...Curiosity and Coforge present - Oracle FLEXCUBE: De-risk upgrades and migrati...
Curiosity and Coforge present - Oracle FLEXCUBE: De-risk upgrades and migrati...
Curiosity Software Ireland
 
Curiosity and Xray present - In sprint testing: Aligning tests and teams to r...
Curiosity and Xray present - In sprint testing: Aligning tests and teams to r...Curiosity and Xray present - In sprint testing: Aligning tests and teams to r...
Curiosity and Xray present - In sprint testing: Aligning tests and teams to r...
Curiosity Software Ireland
 
Curiosity and Lemontree present - Data Breaks DevOps: Why you need automated ...
Curiosity and Lemontree present - Data Breaks DevOps: Why you need automated ...Curiosity and Lemontree present - Data Breaks DevOps: Why you need automated ...
Curiosity and Lemontree present - Data Breaks DevOps: Why you need automated ...
Curiosity Software Ireland
 
Curiosity Software Presents: Modelling for Continuous Testing
Curiosity Software Presents: Modelling for Continuous TestingCuriosity Software Presents: Modelling for Continuous Testing
Curiosity Software Presents: Modelling for Continuous Testing
Curiosity Software Ireland
 
Model-Based Testing for ALM Octane: Better tests, built faster
Model-Based Testing for ALM Octane: Better tests, built faster Model-Based Testing for ALM Octane: Better tests, built faster
Model-Based Testing for ALM Octane: Better tests, built faster
Curiosity Software Ireland
 
Model-Based Testing for Cypress
Model-Based Testing for CypressModel-Based Testing for Cypress
Model-Based Testing for Cypress
Curiosity Software Ireland
 
Test data automation: delivering quality data at speed
Test data automation: delivering quality data at speedTest data automation: delivering quality data at speed
Test data automation: delivering quality data at speed
Curiosity Software Ireland
 

Similar to Curiosity Software Presents: Isolating blast radiuses for testing - How to not blow up your DevOps world (20)

Curiosity and Coforge present - Oracle FLEXCUBE: De-risk upgrades and migrati...
Curiosity and Coforge present - Oracle FLEXCUBE: De-risk upgrades and migrati...Curiosity and Coforge present - Oracle FLEXCUBE: De-risk upgrades and migrati...
Curiosity and Coforge present - Oracle FLEXCUBE: De-risk upgrades and migrati...
 
Dev talks2021 ionut rusu
Dev talks2021   ionut rusuDev talks2021   ionut rusu
Dev talks2021 ionut rusu
 
Curiosity and Xray present - In sprint testing: Aligning tests and teams to r...
Curiosity and Xray present - In sprint testing: Aligning tests and teams to r...Curiosity and Xray present - In sprint testing: Aligning tests and teams to r...
Curiosity and Xray present - In sprint testing: Aligning tests and teams to r...
 
Chaos engineering
Chaos engineering Chaos engineering
Chaos engineering
 
Service Virtualization: What Testers Need to Know
Service Virtualization: What Testers Need to KnowService Virtualization: What Testers Need to Know
Service Virtualization: What Testers Need to Know
 
Curiosity and Lemontree present - Data Breaks DevOps: Why you need automated ...
Curiosity and Lemontree present - Data Breaks DevOps: Why you need automated ...Curiosity and Lemontree present - Data Breaks DevOps: Why you need automated ...
Curiosity and Lemontree present - Data Breaks DevOps: Why you need automated ...
 
API Automation and TDD to Implement Master Data Survivorship Rules
API Automation and TDD to Implement Master Data Survivorship RulesAPI Automation and TDD to Implement Master Data Survivorship Rules
API Automation and TDD to Implement Master Data Survivorship Rules
 
Curiosity Software Presents: Modelling for Continuous Testing
Curiosity Software Presents: Modelling for Continuous TestingCuriosity Software Presents: Modelling for Continuous Testing
Curiosity Software Presents: Modelling for Continuous Testing
 
Model-Based Testing for ALM Octane: Better tests, built faster
Model-Based Testing for ALM Octane: Better tests, built faster Model-Based Testing for ALM Octane: Better tests, built faster
Model-Based Testing for ALM Octane: Better tests, built faster
 
#ATAGTR2021 Presentation : "Chaos engineering: Break it to make it" by Anupa...
#ATAGTR2021 Presentation :  "Chaos engineering: Break it to make it" by Anupa...#ATAGTR2021 Presentation :  "Chaos engineering: Break it to make it" by Anupa...
#ATAGTR2021 Presentation : "Chaos engineering: Break it to make it" by Anupa...
 
Model-Based Testing for Cypress
Model-Based Testing for CypressModel-Based Testing for Cypress
Model-Based Testing for Cypress
 
Testing in the cloud
Testing in the cloudTesting in the cloud
Testing in the cloud
 
Building a Testable Data Access Layer
Building a Testable Data Access LayerBuilding a Testable Data Access Layer
Building a Testable Data Access Layer
 
Continuous Testing
Continuous TestingContinuous Testing
Continuous Testing
 
DockerCon SF 2019 - TDD is Dead
DockerCon SF 2019 - TDD is DeadDockerCon SF 2019 - TDD is Dead
DockerCon SF 2019 - TDD is Dead
 
Architecting for failure - Why are distributed systems hard?
Architecting for failure - Why are distributed systems hard?Architecting for failure - Why are distributed systems hard?
Architecting for failure - Why are distributed systems hard?
 
Test data automation: delivering quality data at speed
Test data automation: delivering quality data at speedTest data automation: delivering quality data at speed
Test data automation: delivering quality data at speed
 
Secure Authorised De-duplication using Convergent Encryption Technique
Secure Authorised De-duplication using Convergent Encryption TechniqueSecure Authorised De-duplication using Convergent Encryption Technique
Secure Authorised De-duplication using Convergent Encryption Technique
 
zenoh: The Edge Data Fabric
zenoh: The Edge Data Fabriczenoh: The Edge Data Fabric
zenoh: The Edge Data Fabric
 
How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...
How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...
How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...
 

More from Curiosity Software Ireland

Curiosity and Testery Present: Hitting the right test coverage for CI/CD
Curiosity and Testery Present: Hitting the right test coverage for CI/CDCuriosity and Testery Present: Hitting the right test coverage for CI/CD
Curiosity and Testery Present: Hitting the right test coverage for CI/CD
Curiosity Software Ireland
 
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity Software Ireland
 
Curiosity and Windocks Present - Turn your production systems into test-ready...
Curiosity and Windocks Present - Turn your production systems into test-ready...Curiosity and Windocks Present - Turn your production systems into test-ready...
Curiosity and Windocks Present - Turn your production systems into test-ready...
Curiosity Software Ireland
 
Curiosity and Sogeti Present - The state of test data in 2022: New challenges...
Curiosity and Sogeti Present - The state of test data in 2022: New challenges...Curiosity and Sogeti Present - The state of test data in 2022: New challenges...
Curiosity and Sogeti Present - The state of test data in 2022: New challenges...
Curiosity Software Ireland
 
Curiosity and Lemontree present - Test Data Automation: Move from slow and ma...
Curiosity and Lemontree present - Test Data Automation: Move from slow and ma...Curiosity and Lemontree present - Test Data Automation: Move from slow and ma...
Curiosity and Lemontree present - Test Data Automation: Move from slow and ma...
Curiosity Software Ireland
 
Curiosity and EPI-USE Labs present - Testing across SAP and non-SAP systems: ...
Curiosity and EPI-USE Labs present - Testing across SAP and non-SAP systems: ...Curiosity and EPI-USE Labs present - Testing across SAP and non-SAP systems: ...
Curiosity and EPI-USE Labs present - Testing across SAP and non-SAP systems: ...
Curiosity Software Ireland
 
Curiosity and SelectorsHub present: Generate Rigorous Automated Tests - and L...
Curiosity and SelectorsHub present: Generate Rigorous Automated Tests - and L...Curiosity and SelectorsHub present: Generate Rigorous Automated Tests - and L...
Curiosity and SelectorsHub present: Generate Rigorous Automated Tests - and L...
Curiosity Software Ireland
 
Curiosity Software, Infuse and Kumoco present: The Democratisation of Testing
Curiosity Software, Infuse and Kumoco present: The Democratisation of TestingCuriosity Software, Infuse and Kumoco present: The Democratisation of Testing
Curiosity Software, Infuse and Kumoco present: The Democratisation of Testing
Curiosity Software Ireland
 
The Broken Promise of Test Automation: Why are we still hand-cranking tests?
The Broken Promise of Test Automation: Why are we still hand-cranking tests?The Broken Promise of Test Automation: Why are we still hand-cranking tests?
The Broken Promise of Test Automation: Why are we still hand-cranking tests?
Curiosity Software Ireland
 
In the beginning there was a model: Using requirements models to drive rigoro...
In the beginning there wasa model: Using requirements models to drive rigoro...In the beginning there wasa model: Using requirements models to drive rigoro...
In the beginning there was a model: Using requirements models to drive rigoro...
Curiosity Software Ireland
 
Curiosity software Ireland and Perfecto present: achieving in-sprint regressi...
Curiosity software Ireland and Perfecto present: achieving in-sprint regressi...Curiosity software Ireland and Perfecto present: achieving in-sprint regressi...
Curiosity software Ireland and Perfecto present: achieving in-sprint regressi...
Curiosity Software Ireland
 
To Open Banking and Beyond: Developing APIs that are Resilient to every new I...
To Open Banking and Beyond: Developing APIs that are Resilient to every new I...To Open Banking and Beyond: Developing APIs that are Resilient to every new I...
To Open Banking and Beyond: Developing APIs that are Resilient to every new I...
Curiosity Software Ireland
 
Five reasons to model during QA
Five reasons to model during QAFive reasons to model during QA
Five reasons to model during QA
Curiosity Software Ireland
 
Model-Based Test Automation: Automate more, automate faster, automate accurately
Model-Based Test Automation: Automate more, automate faster, automate accuratelyModel-Based Test Automation: Automate more, automate faster, automate accurately
Model-Based Test Automation: Automate more, automate faster, automate accurately
Curiosity Software Ireland
 

More from Curiosity Software Ireland (15)

Curiosity and Testery Present: Hitting the right test coverage for CI/CD
Curiosity and Testery Present: Hitting the right test coverage for CI/CDCuriosity and Testery Present: Hitting the right test coverage for CI/CD
Curiosity and Testery Present: Hitting the right test coverage for CI/CD
 
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
Curiosity and Infuse Consulting Present: Sustainable Test Automation Strategi...
 
Curiosity and Windocks Present - Turn your production systems into test-ready...
Curiosity and Windocks Present - Turn your production systems into test-ready...Curiosity and Windocks Present - Turn your production systems into test-ready...
Curiosity and Windocks Present - Turn your production systems into test-ready...
 
Curiosity and Sogeti Present - The state of test data in 2022: New challenges...
Curiosity and Sogeti Present - The state of test data in 2022: New challenges...Curiosity and Sogeti Present - The state of test data in 2022: New challenges...
Curiosity and Sogeti Present - The state of test data in 2022: New challenges...
 
Curiosity and Lemontree present - Test Data Automation: Move from slow and ma...
Curiosity and Lemontree present - Test Data Automation: Move from slow and ma...Curiosity and Lemontree present - Test Data Automation: Move from slow and ma...
Curiosity and Lemontree present - Test Data Automation: Move from slow and ma...
 
Curiosity Software and RCG Global Services Present - Solving Test Data: the g...
Curiosity Software and RCG Global Services Present - Solving Test Data: the g...Curiosity Software and RCG Global Services Present - Solving Test Data: the g...
Curiosity Software and RCG Global Services Present - Solving Test Data: the g...
 
Curiosity and EPI-USE Labs present - Testing across SAP and non-SAP systems: ...
Curiosity and EPI-USE Labs present - Testing across SAP and non-SAP systems: ...Curiosity and EPI-USE Labs present - Testing across SAP and non-SAP systems: ...
Curiosity and EPI-USE Labs present - Testing across SAP and non-SAP systems: ...
 
Curiosity and SelectorsHub present: Generate Rigorous Automated Tests - and L...
Curiosity and SelectorsHub present: Generate Rigorous Automated Tests - and L...Curiosity and SelectorsHub present: Generate Rigorous Automated Tests - and L...
Curiosity and SelectorsHub present: Generate Rigorous Automated Tests - and L...
 
Curiosity Software, Infuse and Kumoco present: The Democratisation of Testing
Curiosity Software, Infuse and Kumoco present: The Democratisation of TestingCuriosity Software, Infuse and Kumoco present: The Democratisation of Testing
Curiosity Software, Infuse and Kumoco present: The Democratisation of Testing
 
The Broken Promise of Test Automation: Why are we still hand-cranking tests?
The Broken Promise of Test Automation: Why are we still hand-cranking tests?The Broken Promise of Test Automation: Why are we still hand-cranking tests?
The Broken Promise of Test Automation: Why are we still hand-cranking tests?
 
In the beginning there was a model: Using requirements models to drive rigoro...
In the beginning there wasa model: Using requirements models to drive rigoro...In the beginning there wasa model: Using requirements models to drive rigoro...
In the beginning there was a model: Using requirements models to drive rigoro...
 
Curiosity software Ireland and Perfecto present: achieving in-sprint regressi...
Curiosity software Ireland and Perfecto present: achieving in-sprint regressi...Curiosity software Ireland and Perfecto present: achieving in-sprint regressi...
Curiosity software Ireland and Perfecto present: achieving in-sprint regressi...
 
To Open Banking and Beyond: Developing APIs that are Resilient to every new I...
To Open Banking and Beyond: Developing APIs that are Resilient to every new I...To Open Banking and Beyond: Developing APIs that are Resilient to every new I...
To Open Banking and Beyond: Developing APIs that are Resilient to every new I...
 
Five reasons to model during QA
Five reasons to model during QAFive reasons to model during QA
Five reasons to model during QA
 
Model-Based Test Automation: Automate more, automate faster, automate accurately
Model-Based Test Automation: Automate more, automate faster, automate accuratelyModel-Based Test Automation: Automate more, automate faster, automate accurately
Model-Based Test Automation: Automate more, automate faster, automate accurately
 

Recently uploaded

AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
Alluxio, Inc.
 
Mastering Windows 7 A Comprehensive Guide for Power Users .pdf
Mastering Windows 7 A Comprehensive Guide for Power Users .pdfMastering Windows 7 A Comprehensive Guide for Power Users .pdf
Mastering Windows 7 A Comprehensive Guide for Power Users .pdf
mbmh111980
 

Recently uploaded (20)

A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1
A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1
A Python-based approach to data loading in TM1 - Using Airflow as an ETL for TM1
 
Entropy, Software Quality, and Innovation (presented at Princeton Plasma Phys...
Entropy, Software Quality, and Innovation (presented at Princeton Plasma Phys...Entropy, Software Quality, and Innovation (presented at Princeton Plasma Phys...
Entropy, Software Quality, and Innovation (presented at Princeton Plasma Phys...
 
How to install and activate eGrabber JobGrabber
How to install and activate eGrabber JobGrabberHow to install and activate eGrabber JobGrabber
How to install and activate eGrabber JobGrabber
 
Microsoft 365 Copilot; An AI tool changing the world of work _PDF.pdf
Microsoft 365 Copilot; An AI tool changing the world of work _PDF.pdfMicrosoft 365 Copilot; An AI tool changing the world of work _PDF.pdf
Microsoft 365 Copilot; An AI tool changing the world of work _PDF.pdf
 
AI/ML Infra Meetup | ML explainability in Michelangelo
AI/ML Infra Meetup | ML explainability in MichelangeloAI/ML Infra Meetup | ML explainability in Michelangelo
AI/ML Infra Meetup | ML explainability in Michelangelo
 
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
AI/ML Infra Meetup | Improve Speed and GPU Utilization for Model Training & S...
 
how-to-download-files-safely-from-the-internet.pdf
how-to-download-files-safely-from-the-internet.pdfhow-to-download-files-safely-from-the-internet.pdf
how-to-download-files-safely-from-the-internet.pdf
 
Mastering Windows 7 A Comprehensive Guide for Power Users .pdf
Mastering Windows 7 A Comprehensive Guide for Power Users .pdfMastering Windows 7 A Comprehensive Guide for Power Users .pdf
Mastering Windows 7 A Comprehensive Guide for Power Users .pdf
 
The Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdf
The Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdfThe Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdf
The Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdf
 
Odoo vs Shopify: Why Odoo is Best for Ecommerce Website Builder in 2024
Odoo vs Shopify: Why Odoo is Best for Ecommerce Website Builder in 2024Odoo vs Shopify: Why Odoo is Best for Ecommerce Website Builder in 2024
Odoo vs Shopify: Why Odoo is Best for Ecommerce Website Builder in 2024
 
architecting-ai-in-the-enterprise-apis-and-applications.pdf
architecting-ai-in-the-enterprise-apis-and-applications.pdfarchitecting-ai-in-the-enterprise-apis-and-applications.pdf
architecting-ai-in-the-enterprise-apis-and-applications.pdf
 
IT Software Development Resume, Vaibhav jha 2024
IT Software Development Resume, Vaibhav jha 2024IT Software Development Resume, Vaibhav jha 2024
IT Software Development Resume, Vaibhav jha 2024
 
Secure Software Ecosystem Teqnation 2024
Secure Software Ecosystem Teqnation 2024Secure Software Ecosystem Teqnation 2024
Secure Software Ecosystem Teqnation 2024
 
Crafting the Perfect Measurement Sheet with PLM Integration
Crafting the Perfect Measurement Sheet with PLM IntegrationCrafting the Perfect Measurement Sheet with PLM Integration
Crafting the Perfect Measurement Sheet with PLM Integration
 
Modern binary build systems - PyCon 2024
Modern binary build systems - PyCon 2024Modern binary build systems - PyCon 2024
Modern binary build systems - PyCon 2024
 
The Impact of PLM Software on Fashion Production
The Impact of PLM Software on Fashion ProductionThe Impact of PLM Software on Fashion Production
The Impact of PLM Software on Fashion Production
 
Tree in the Forest - Managing Details in BDD Scenarios (live2test 2024)
Tree in the Forest - Managing Details in BDD Scenarios (live2test 2024)Tree in the Forest - Managing Details in BDD Scenarios (live2test 2024)
Tree in the Forest - Managing Details in BDD Scenarios (live2test 2024)
 
AI/ML Infra Meetup | Reducing Prefill for LLM Serving in RAG
AI/ML Infra Meetup | Reducing Prefill for LLM Serving in RAGAI/ML Infra Meetup | Reducing Prefill for LLM Serving in RAG
AI/ML Infra Meetup | Reducing Prefill for LLM Serving in RAG
 
COMPUTER AND ITS COMPONENTS PPT.by naitik sharma Class 9th A mittal internati...
COMPUTER AND ITS COMPONENTS PPT.by naitik sharma Class 9th A mittal internati...COMPUTER AND ITS COMPONENTS PPT.by naitik sharma Class 9th A mittal internati...
COMPUTER AND ITS COMPONENTS PPT.by naitik sharma Class 9th A mittal internati...
 
OpenChain Webinar: AboutCode and Beyond - End-to-End SCA
OpenChain Webinar: AboutCode and Beyond - End-to-End SCAOpenChain Webinar: AboutCode and Beyond - End-to-End SCA
OpenChain Webinar: AboutCode and Beyond - End-to-End SCA
 

Curiosity Software Presents: Isolating blast radiuses for testing - How to not blow up your DevOps world

  • 1. © Curiosity Software Ireland Ltd. 2023 Isolating blast radiuses for testing How to not blow up your DevOps world Toby Richardson Test Data Engineer Toby.Richardson@Curiosity.Software @CuriositySoft Rich Jordan Enterprise Solutions Architect, Curiosity Rich.Jordan@Curiosity.Software @RichJordan81
  • 2. © Curiosity Software 2023 You have a “DevOps” Transformation, but your Test approach hasn’t really changed Too many e2e tests high cost / time to maintain test assets 10001110101 10101110101 10001010101 10011110101 10001110111 Bloated (regression) test packs Accidental complexity • Combinatorial explosions • Huge Data requirements • Huge test environment requirements • Large duplication in test coverage A Separation between what is being tested and how the system actually works / changes Too many UI Tests DevOps loop. Original Image: Khanargy, Wikimedia Commons, published under CC BY-SA 4.0 license.
  • 3. © Curiosity Software 2023 Your environment and test data approach (or lack of) © vincentdnl Used with permission from the creator.
  • 4. © Curiosity Software 2023 The 3 ways of DevOps The Three Ways: The Principles Underpinning DevOps by Gene Kim / IT Revolution https://itrevolution.com/articles/the-three-ways-principles-underpinning-devops/ Original Image: Khanargy, Wikimedia Commons, published under CC BY-SA 4.0 license. Flow • Never passing a known defect to downstream work centers • Never allowing local optimization to create global degradation • Always seeking to increase flow • Always seeking to achieve profound understanding of the system Amplify Feedback Loops • Shortening and amplifying all feedback loops • Embedding knowledge where we need it. Culture of Continual Experimentation & Learning • Continual experimentation • Taking risks and learning from failure • Understanding that repetition and practice is the prerequisite to mastery
  • 5. © Curiosity Software 2023 Getting your Test Approach right - Maintain coherence with product design and established design principles
  • 6. © Curiosity Software 2023 Shortening and amplifying feedback loops – modelling for isolation 1) Reinforcing / proving the external boundaries 2) Reinforcing / proving the internal boundaries 3) Proving the systems elements in isolation 4) Proving batch / reporting 5) Proving the golden thread of the platform 6) Stakeholder demonstration This is more “acceptance” than testing. If testing focuses here, it will become bloated, and both your platform and change will become monolithic.
  • 7. © Curiosity Software 2023 Understanding and visualizing the flow of data 1. What data flows between systems? 2. What relationships exist between the data being passed around systems? I need to understand (or be confident enough about) the whole before we can set out a strategy to isolate Tip: The Accidental complexity of “we don’t have time to do this” will inevitably keep you locked into the big integration problems you have today – and they will only get worse the longer you put this off! Data flowing Some of its possible relationships
  • 8. Demo © Curiosity Software Ireland Ltd. 2023
  • 9. © Curiosity Software 2023 Ephemeral environments – Unleash virtual databases Persistent environments come hand in hand with large sets of stagnant test data That data might even be live data! Data ages and becomes useless – Get Rid of it! We are so wasteful when it comes to duplicated / dormant test infrastructure Ephemeral = short lived “Understanding that repetition and practice is the prerequisite to mastery” V1, Sprint 4 V1, Sprint 3 V1, Sprint 2 Point-in-time data dump V1, Sprint 1 Bugs found New RQMTs V2, Sprint 2 V2, Sprint 1 Big trouble “Waterfall” data provisioning (static dumps) “Parallel” teams One single, static source of truth “Ephemeral” environments • Available in parallel - teams, versions • Tailored to the blast radius of the moment
  • 10. Demo © Curiosity Software Ireland Ltd. 2023
  • 11. © Curiosity Software 2023 Stubbing / Sandboxes We don’t need that e2e environment In fact, we don’t even need the real interface But we do need a representation of the interface And we need data / Reponses to be in different states (stateful) “Never allowing local optimization to create global degradation” “Always seeking to increase flow” “Always seeking to achieve profound understanding of the system” Constrained component Costly infrastructure Unfinished integration E2E environment Complex, costly, unavailable in parallel Request Response Virtual Service Stateful DB
  • 12. Demo © Curiosity Software Ireland Ltd. 2023
  • 13. © Curiosity Software 2023 Linking tests (models) to your data Whilst I’ve made optimizations to my environment, my data is still separate from my tests I still might suffer test >< data drift Can I link, or better still generate data linked to the tests I want to run? Or even create Models / Tests from my data? “Never passing a known defect to downstream work centers” Change: traceability and risk analysis User stories Test generation Test Data Automation Virtual Sandboxing
  • 14. Demo © Curiosity Software Ireland Ltd. 2023
  • 15. © Curiosity Software Ireland Ltd. 2023 Questions and Discussion
  • 16. © Curiosity Software 2023 Carry on the conversation? • Check out Rich’s February webinar: “Modelling for Continuous Testing” • Book a demo and discussion with a Curiosity expert! • Try Test Modeller. Visit Testmodeller.io for a free trial and online tutorials. • Follow Curiosity Software on LinkedIn and @CuriositySoft on Twitter for resources and news. • Connect with Rich and Toby on LinkedIn.
  • 17. © Curiosity Software Ireland Ltd. 2023 Thank you Rich.Jordan@Curiosity.Software Toby.Richardson@Curiosity.Software