SlideShare a Scribd company logo
1 of 11
Download to read offline
www.enov8.com 1
Test Environment Management
The Top 8 Anti Patterns (& Patterns) of TEM
www.enov8.com 2
Test Environment Anti Patterns
A list of the top 8 Anti-Patterns* found in organizations
Test Environment Management space. Anti-Patterns
that cause disruption, low productivity, delivery delays
and unwanted costs. And conversely recommended
patterns to replace them.
*Definition: Anti-Pattern.
An Anti-Pattern is basically a commonly occurring
approach to a problem or task that generates decidedly
negative consequences.
www.enov8.com 3
1 Death by Spreadsheet
Anti-Pattern:
The enterprise is heavily reliant on spreadsheets to
identify current applications/platforms under
management, their components, versions and the
projects using them. These spreadsheets often get out
of date, are non-integrated across teams & regularly
become unwieldy.
Pattern:
A centralised Configuration Management Database or
Knowledge Portal that all teams can use for
visualisation, modelling and ongoing-management of
systems, components, relationships, versions, and of
course relationships
www.enov8.com 4
2. System Contention Hell
Anti-Pattern:
Different teams “reactively” compete for the same system /
platform resources and components, causing test
disruption & outages due to continual changes and re-
configurations. Collaboration across projects is typically
very low and often results in finger pointing and
arguments.
Pattern:
Project requirements are identified early in the lifecycle
and the correct system resources are shared with the
most compatible teams. In areas of high contention, the
organisation has time to provision new environments
and/or re-prioritise to meet the spike in demand.
www.enov8.com 5
3 Ninja Changes
Anti-Pattern:
Developers deploy changes during operational hours,
without prior notice and re-configure applications on
the fly. The test teams are blind-sided, experience
unwanted disruption and defects arise that are often
difficult to recreate or track.
Pattern:
All environment activity is collaborated through group
calendars that highlight scheduled events and status.
Affected teams are notified of any changes, via alerts
or dashboarding, that may impact their project or
team.
www.enov8.com 6
4 The Email Support Vortex
Anti-Pattern:
Members across the project use email as a method to
request test environment support and coordinate
operational fulfilment. High volumes of emails go across
different teams and fail to convey ownership, accountability
or correct operational procedures. Thus, requests become
overwhelming, uncoordinated and are often ignored or lost.
Pattern:
All environments, whether production or test, need a basic
level of service management to prevent operational chaos.
Although not necessarily as “heavy” as production, the
organisation needs “just enough” service management to
ensure all requirements are captured, tracked & closed.
www.enov8.com 7
5 Superhero Provisioning
Anti-Pattern:
Deployment Operations (across data, application &
infrastructure) are unrepeatable, manual, slow and
error prone. They typically involve heroics from one or
more subject matter experts and the use of “black
magic”. This chaotic approach consequently results in
disruption to the end users i.e. project and test teams.
Pattern:
Organisations need to establish consistent /
standardized tasks that are clearly documented and
understood. Ideally these operations should evolve to
become fully automated, “Single command line” tasks
that can be exposed through “Self Service” forms.
www.enov8.com 8
6 Manual Health Checks
Anti-Pattern:
Every morning the test team will get in early (the crack of
dawn) to run various functional tests that ensure the
application and the end-to-end business processes are
working. Results are then emailed to the test teams.
Process is typically time-consuming and typically can only
be done once a day.
Pattern:
Implementation of Test Synthetics that can automatically
run at any time of the day, (scheduled or in real time) to
provide immediate insight into whether the end-to-end
environments are healthy. Results can be communicated
via real-time dashboards and automated alerts.
www.enov8.com 9
7 Stopping the Clock
Anti-Patterns:
Testing and projects are often delayed due to the various
delivery teams not being available to service them. For
example, the infrastructure team are too busy to provide more
virtual test environments, the deployment team are too busy to
release the latest code version and the data team don’t have
time to provide new test data.
Pattern:
Establishment of Self Service orchestration gateways (portals
where provisioning automation is exposed & shared) will
ultimately mean much of the “busy” work previously done by
the Infrastructure, Application or Data team can be completed
by the testers or project team themselves.
www.enov8.com 10
8 Creative Reporting
Anti-Pattern:
The test environment & release management teams
spend many days (potentially weeks) per month
collating and analysing non-integrated environment &
release information with the intent of creating reports.
Typically resulting in reports which are invariably
inaccurate & untimely (out of date).
Pattern:
Establish automated environment information
aggregation that brings together all your IT
environment & release information and generates real-
time reports and dashboards that support analytics
and decision making.
www.enov8.com 11
Thankyou
If you’d like to know how to avoid anti-patterns and address
all the above and more, then please ask for a demonstration
of enov8 Environment Manager.
A complete solution for your Test Environment Managers,
including features for: Visual Configuration Management,
Project Demand Management & Test Environment Bookings,
Environment Calendaring, Service Management, Self
Service, Test Synthetics, Environment Dashboarding and
Automation Integration & Orchestration.
References:
https://www.enov8.com/blog/test-environment-anti-patterns/

More Related Content

What's hot

Preparing to set up your test environment
Preparing to set up your test environmentPreparing to set up your test environment
Preparing to set up your test environmentTestplant
 
No more excuses QASymphony
No more excuses QASymphonyNo more excuses QASymphony
No more excuses QASymphonyQASymphony
 
Microsoft and DevOps
Microsoft and DevOpsMicrosoft and DevOps
Microsoft and DevOpsJames Tramel
 
Automated testing handbook
Automated testing handbookAutomated testing handbook
Automated testing handbookAndrei Hortúa
 
Test Data Management: The Underestimated Pain
Test Data Management: The Underestimated PainTest Data Management: The Underestimated Pain
Test Data Management: The Underestimated PainChelsea Frischknecht
 
The Leaders Guide to Getting Started with Automated Testing
The Leaders Guide to Getting Started with Automated TestingThe Leaders Guide to Getting Started with Automated Testing
The Leaders Guide to Getting Started with Automated TestingJames Briers
 
Best Practises In Test Automation
Best Practises In Test AutomationBest Practises In Test Automation
Best Practises In Test Automation99tests
 
Extreme Automation Enables DirecTV to ”Shift Left” API Testing
Extreme Automation Enables DirecTV to ”Shift Left” API TestingExtreme Automation Enables DirecTV to ”Shift Left” API Testing
Extreme Automation Enables DirecTV to ”Shift Left” API TestingParasoft
 
AfterTest Madrid March 2016 - DevOps and Testing Introduction
AfterTest Madrid March 2016 - DevOps and Testing IntroductionAfterTest Madrid March 2016 - DevOps and Testing Introduction
AfterTest Madrid March 2016 - DevOps and Testing IntroductionPeter Marshall
 
Emerging QA COE Practice by Mukund Wangikar
Emerging QA COE Practice by Mukund WangikarEmerging QA COE Practice by Mukund Wangikar
Emerging QA COE Practice by Mukund WangikarAgile Testing Alliance
 
Test strategicaly
Test strategicalyTest strategicaly
Test strategicalyErik Lebel
 
Nuevosoft Test Manager Overview
Nuevosoft Test Manager OverviewNuevosoft Test Manager Overview
Nuevosoft Test Manager OverviewSuhas Patil
 
SRE-iously! Defining the Principles, Habits, and Practices of Site Reliabilit...
SRE-iously! Defining the Principles, Habits, and Practices of Site Reliabilit...SRE-iously! Defining the Principles, Habits, and Practices of Site Reliabilit...
SRE-iously! Defining the Principles, Habits, and Practices of Site Reliabilit...Tori Wieldt
 
Top 5 Pitfalls of Test Automation and How To Avoid Them
Top 5 Pitfalls of Test Automation and How To Avoid ThemTop 5 Pitfalls of Test Automation and How To Avoid Them
Top 5 Pitfalls of Test Automation and How To Avoid ThemSundar Sritharan
 
What is sanity testing
What is sanity testingWhat is sanity testing
What is sanity testingpooja deshmukh
 
Seven testing principles
Seven testing principlesSeven testing principles
Seven testing principlesVaibhav Dash
 

What's hot (20)

Preparing to set up your test environment
Preparing to set up your test environmentPreparing to set up your test environment
Preparing to set up your test environment
 
No more excuses QASymphony
No more excuses QASymphonyNo more excuses QASymphony
No more excuses QASymphony
 
Microsoft and DevOps
Microsoft and DevOpsMicrosoft and DevOps
Microsoft and DevOps
 
Automated testing handbook
Automated testing handbookAutomated testing handbook
Automated testing handbook
 
Test Data Management: The Underestimated Pain
Test Data Management: The Underestimated PainTest Data Management: The Underestimated Pain
Test Data Management: The Underestimated Pain
 
The Leaders Guide to Getting Started with Automated Testing
The Leaders Guide to Getting Started with Automated TestingThe Leaders Guide to Getting Started with Automated Testing
The Leaders Guide to Getting Started with Automated Testing
 
Best Practises In Test Automation
Best Practises In Test AutomationBest Practises In Test Automation
Best Practises In Test Automation
 
Performance Testing - Keytorc Approach
Performance Testing - Keytorc ApproachPerformance Testing - Keytorc Approach
Performance Testing - Keytorc Approach
 
Extreme Automation Enables DirecTV to ”Shift Left” API Testing
Extreme Automation Enables DirecTV to ”Shift Left” API TestingExtreme Automation Enables DirecTV to ”Shift Left” API Testing
Extreme Automation Enables DirecTV to ”Shift Left” API Testing
 
AfterTest Madrid March 2016 - DevOps and Testing Introduction
AfterTest Madrid March 2016 - DevOps and Testing IntroductionAfterTest Madrid March 2016 - DevOps and Testing Introduction
AfterTest Madrid March 2016 - DevOps and Testing Introduction
 
Emerging QA COE Practice by Mukund Wangikar
Emerging QA COE Practice by Mukund WangikarEmerging QA COE Practice by Mukund Wangikar
Emerging QA COE Practice by Mukund Wangikar
 
Test strategicaly
Test strategicalyTest strategicaly
Test strategicaly
 
Nuevosoft Test Manager Overview
Nuevosoft Test Manager OverviewNuevosoft Test Manager Overview
Nuevosoft Test Manager Overview
 
Testing Metrics
Testing MetricsTesting Metrics
Testing Metrics
 
SRE-iously! Defining the Principles, Habits, and Practices of Site Reliabilit...
SRE-iously! Defining the Principles, Habits, and Practices of Site Reliabilit...SRE-iously! Defining the Principles, Habits, and Practices of Site Reliabilit...
SRE-iously! Defining the Principles, Habits, and Practices of Site Reliabilit...
 
7 testing principles
7 testing principles7 testing principles
7 testing principles
 
Top 5 Pitfalls of Test Automation and How To Avoid Them
Top 5 Pitfalls of Test Automation and How To Avoid ThemTop 5 Pitfalls of Test Automation and How To Avoid Them
Top 5 Pitfalls of Test Automation and How To Avoid Them
 
Principles of software testing
Principles of software testingPrinciples of software testing
Principles of software testing
 
What is sanity testing
What is sanity testingWhat is sanity testing
What is sanity testing
 
Seven testing principles
Seven testing principlesSeven testing principles
Seven testing principles
 

Similar to Test environment management anti patterns

Implementing a testing strategy
Implementing a testing strategyImplementing a testing strategy
Implementing a testing strategyDaniel Giraldo
 
Resilience and Compliance at Speed and Scale
Resilience and Compliance at Speed and ScaleResilience and Compliance at Speed and Scale
Resilience and Compliance at Speed and ScaleJason Chan
 
Test Environment Management
Test Environment ManagementTest Environment Management
Test Environment ManagementKanoah
 
Test Automation Framework Design | www.idexcel.com
Test Automation Framework Design | www.idexcel.comTest Automation Framework Design | www.idexcel.com
Test Automation Framework Design | www.idexcel.comIdexcel Technologies
 
Software Risk Analysis
Software Risk AnalysisSoftware Risk Analysis
Software Risk AnalysisBrett Leonard
 
Workshop BI/DWH AGILE TESTING SNS Bank English
Workshop BI/DWH AGILE TESTING SNS Bank EnglishWorkshop BI/DWH AGILE TESTING SNS Bank English
Workshop BI/DWH AGILE TESTING SNS Bank EnglishMarcus Drost
 
What are the common Test Environment today
What are the common Test Environment todayWhat are the common Test Environment today
What are the common Test Environment todayDoris Robinson
 
Product Brief – Plutora Environments
Product Brief – Plutora EnvironmentsProduct Brief – Plutora Environments
Product Brief – Plutora EnvironmentsPlutora
 
Continuous delivery
Continuous deliveryContinuous delivery
Continuous deliveryMasas Dani
 
Netreo whitepaper 5 ways to avoid it management becoming shelfware
Netreo whitepaper   5 ways to avoid it management becoming shelfwareNetreo whitepaper   5 ways to avoid it management becoming shelfware
Netreo whitepaper 5 ways to avoid it management becoming shelfwarePeter Reynolds
 
Deatra Lopez QA IVV July 16 (6)
Deatra Lopez QA IVV July 16 (6)Deatra Lopez QA IVV July 16 (6)
Deatra Lopez QA IVV July 16 (6)Deatra Lopez
 
Implementing Vulnerability Management
Implementing Vulnerability Management Implementing Vulnerability Management
Implementing Vulnerability Management Argyle Executive Forum
 
How Enterprise Architects Can Build Resilient, Reliable Software-Based Health...
How Enterprise Architects Can Build Resilient, Reliable Software-Based Health...How Enterprise Architects Can Build Resilient, Reliable Software-Based Health...
How Enterprise Architects Can Build Resilient, Reliable Software-Based Health...Cognizant
 
Asp Abstracts, Sample Copy 15+ Abstracts
Asp Abstracts, Sample Copy 15+ AbstractsAsp Abstracts, Sample Copy 15+ Abstracts
Asp Abstracts, Sample Copy 15+ Abstractsncct
 
Impetus qLabs Solutions
Impetus qLabs SolutionsImpetus qLabs Solutions
Impetus qLabs SolutionsVipul Gupta
 
Object Oriented Testing
Object Oriented TestingObject Oriented Testing
Object Oriented TestingAMITJain879
 
Automation of Release and Deployment Management - Maveric
Automation of Release and Deployment Management - MavericAutomation of Release and Deployment Management - Maveric
Automation of Release and Deployment Management - MavericMaveric Systems
 
Testing Data & Data-Centric Applications - Whitepaper
Testing Data & Data-Centric Applications - WhitepaperTesting Data & Data-Centric Applications - Whitepaper
Testing Data & Data-Centric Applications - WhitepaperRyan Dowd
 

Similar to Test environment management anti patterns (20)

Implementing a testing strategy
Implementing a testing strategyImplementing a testing strategy
Implementing a testing strategy
 
Resilience and Compliance at Speed and Scale
Resilience and Compliance at Speed and ScaleResilience and Compliance at Speed and Scale
Resilience and Compliance at Speed and Scale
 
Test Environment Management
Test Environment ManagementTest Environment Management
Test Environment Management
 
Test Automation Framework Design | www.idexcel.com
Test Automation Framework Design | www.idexcel.comTest Automation Framework Design | www.idexcel.com
Test Automation Framework Design | www.idexcel.com
 
Software Risk Analysis
Software Risk AnalysisSoftware Risk Analysis
Software Risk Analysis
 
Workshop BI/DWH AGILE TESTING SNS Bank English
Workshop BI/DWH AGILE TESTING SNS Bank EnglishWorkshop BI/DWH AGILE TESTING SNS Bank English
Workshop BI/DWH AGILE TESTING SNS Bank English
 
What are the common Test Environment today
What are the common Test Environment todayWhat are the common Test Environment today
What are the common Test Environment today
 
Product Brief – Plutora Environments
Product Brief – Plutora EnvironmentsProduct Brief – Plutora Environments
Product Brief – Plutora Environments
 
Continuous delivery
Continuous deliveryContinuous delivery
Continuous delivery
 
Netreo whitepaper 5 ways to avoid it management becoming shelfware
Netreo whitepaper   5 ways to avoid it management becoming shelfwareNetreo whitepaper   5 ways to avoid it management becoming shelfware
Netreo whitepaper 5 ways to avoid it management becoming shelfware
 
Deatra Lopez QA IVV July 16 (6)
Deatra Lopez QA IVV July 16 (6)Deatra Lopez QA IVV July 16 (6)
Deatra Lopez QA IVV July 16 (6)
 
Implementing Vulnerability Management
Implementing Vulnerability Management Implementing Vulnerability Management
Implementing Vulnerability Management
 
Faq
FaqFaq
Faq
 
How Enterprise Architects Can Build Resilient, Reliable Software-Based Health...
How Enterprise Architects Can Build Resilient, Reliable Software-Based Health...How Enterprise Architects Can Build Resilient, Reliable Software-Based Health...
How Enterprise Architects Can Build Resilient, Reliable Software-Based Health...
 
Asp Abstracts, Sample Copy 15+ Abstracts
Asp Abstracts, Sample Copy 15+ AbstractsAsp Abstracts, Sample Copy 15+ Abstracts
Asp Abstracts, Sample Copy 15+ Abstracts
 
Impetus qLabs Solutions
Impetus qLabs SolutionsImpetus qLabs Solutions
Impetus qLabs Solutions
 
Object Oriented Testing
Object Oriented TestingObject Oriented Testing
Object Oriented Testing
 
Pp 14-new
Pp 14-newPp 14-new
Pp 14-new
 
Automation of Release and Deployment Management - Maveric
Automation of Release and Deployment Management - MavericAutomation of Release and Deployment Management - Maveric
Automation of Release and Deployment Management - Maveric
 
Testing Data & Data-Centric Applications - Whitepaper
Testing Data & Data-Centric Applications - WhitepaperTesting Data & Data-Centric Applications - Whitepaper
Testing Data & Data-Centric Applications - Whitepaper
 

Recently uploaded

Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsNathaniel Shimoni
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
Assure Ecommerce and Retail Operations Uptime with ThousandEyes
Assure Ecommerce and Retail Operations Uptime with ThousandEyesAssure Ecommerce and Retail Operations Uptime with ThousandEyes
Assure Ecommerce and Retail Operations Uptime with ThousandEyesThousandEyes
 
Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterMydbops
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesThousandEyes
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...panagenda
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsRavi Sanghani
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentPim van der Noll
 
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfConnecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfNeo4j
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersNicole Novielli
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesKari Kakkonen
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 

Recently uploaded (20)

Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
Assure Ecommerce and Retail Operations Uptime with ThousandEyes
Assure Ecommerce and Retail Operations Uptime with ThousandEyesAssure Ecommerce and Retail Operations Uptime with ThousandEyes
Assure Ecommerce and Retail Operations Uptime with ThousandEyes
 
Scale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL RouterScale your database traffic with Read & Write split using MySQL Router
Scale your database traffic with Read & Write split using MySQL Router
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyesHow to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
How to Effectively Monitor SD-WAN and SASE Environments with ThousandEyes
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
Why device, WIFI, and ISP insights are crucial to supporting remote Microsoft...
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and InsightsPotential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and Insights
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentEmixa Mendix Meetup 11 April 2024 about Mendix Native development
Emixa Mendix Meetup 11 April 2024 about Mendix Native development
 
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfConnecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdf
 
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software DevelopersA Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examples
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 

Test environment management anti patterns

  • 1. www.enov8.com 1 Test Environment Management The Top 8 Anti Patterns (& Patterns) of TEM
  • 2. www.enov8.com 2 Test Environment Anti Patterns A list of the top 8 Anti-Patterns* found in organizations Test Environment Management space. Anti-Patterns that cause disruption, low productivity, delivery delays and unwanted costs. And conversely recommended patterns to replace them. *Definition: Anti-Pattern. An Anti-Pattern is basically a commonly occurring approach to a problem or task that generates decidedly negative consequences.
  • 3. www.enov8.com 3 1 Death by Spreadsheet Anti-Pattern: The enterprise is heavily reliant on spreadsheets to identify current applications/platforms under management, their components, versions and the projects using them. These spreadsheets often get out of date, are non-integrated across teams & regularly become unwieldy. Pattern: A centralised Configuration Management Database or Knowledge Portal that all teams can use for visualisation, modelling and ongoing-management of systems, components, relationships, versions, and of course relationships
  • 4. www.enov8.com 4 2. System Contention Hell Anti-Pattern: Different teams “reactively” compete for the same system / platform resources and components, causing test disruption & outages due to continual changes and re- configurations. Collaboration across projects is typically very low and often results in finger pointing and arguments. Pattern: Project requirements are identified early in the lifecycle and the correct system resources are shared with the most compatible teams. In areas of high contention, the organisation has time to provision new environments and/or re-prioritise to meet the spike in demand.
  • 5. www.enov8.com 5 3 Ninja Changes Anti-Pattern: Developers deploy changes during operational hours, without prior notice and re-configure applications on the fly. The test teams are blind-sided, experience unwanted disruption and defects arise that are often difficult to recreate or track. Pattern: All environment activity is collaborated through group calendars that highlight scheduled events and status. Affected teams are notified of any changes, via alerts or dashboarding, that may impact their project or team.
  • 6. www.enov8.com 6 4 The Email Support Vortex Anti-Pattern: Members across the project use email as a method to request test environment support and coordinate operational fulfilment. High volumes of emails go across different teams and fail to convey ownership, accountability or correct operational procedures. Thus, requests become overwhelming, uncoordinated and are often ignored or lost. Pattern: All environments, whether production or test, need a basic level of service management to prevent operational chaos. Although not necessarily as “heavy” as production, the organisation needs “just enough” service management to ensure all requirements are captured, tracked & closed.
  • 7. www.enov8.com 7 5 Superhero Provisioning Anti-Pattern: Deployment Operations (across data, application & infrastructure) are unrepeatable, manual, slow and error prone. They typically involve heroics from one or more subject matter experts and the use of “black magic”. This chaotic approach consequently results in disruption to the end users i.e. project and test teams. Pattern: Organisations need to establish consistent / standardized tasks that are clearly documented and understood. Ideally these operations should evolve to become fully automated, “Single command line” tasks that can be exposed through “Self Service” forms.
  • 8. www.enov8.com 8 6 Manual Health Checks Anti-Pattern: Every morning the test team will get in early (the crack of dawn) to run various functional tests that ensure the application and the end-to-end business processes are working. Results are then emailed to the test teams. Process is typically time-consuming and typically can only be done once a day. Pattern: Implementation of Test Synthetics that can automatically run at any time of the day, (scheduled or in real time) to provide immediate insight into whether the end-to-end environments are healthy. Results can be communicated via real-time dashboards and automated alerts.
  • 9. www.enov8.com 9 7 Stopping the Clock Anti-Patterns: Testing and projects are often delayed due to the various delivery teams not being available to service them. For example, the infrastructure team are too busy to provide more virtual test environments, the deployment team are too busy to release the latest code version and the data team don’t have time to provide new test data. Pattern: Establishment of Self Service orchestration gateways (portals where provisioning automation is exposed & shared) will ultimately mean much of the “busy” work previously done by the Infrastructure, Application or Data team can be completed by the testers or project team themselves.
  • 10. www.enov8.com 10 8 Creative Reporting Anti-Pattern: The test environment & release management teams spend many days (potentially weeks) per month collating and analysing non-integrated environment & release information with the intent of creating reports. Typically resulting in reports which are invariably inaccurate & untimely (out of date). Pattern: Establish automated environment information aggregation that brings together all your IT environment & release information and generates real- time reports and dashboards that support analytics and decision making.
  • 11. www.enov8.com 11 Thankyou If you’d like to know how to avoid anti-patterns and address all the above and more, then please ask for a demonstration of enov8 Environment Manager. A complete solution for your Test Environment Managers, including features for: Visual Configuration Management, Project Demand Management & Test Environment Bookings, Environment Calendaring, Service Management, Self Service, Test Synthetics, Environment Dashboarding and Automation Integration & Orchestration. References: https://www.enov8.com/blog/test-environment-anti-patterns/