Test Environments for Continuous Delivery

•Download as PPTX, PDF•

2 likes•1,177 views

Overview presentation of some thoughts around test environment challenges in the context of continuous delivery. Including why pre-production environments could be an anti-pattern

Clem Pickering
clement.pickering@callcreditgroup.com
Clement Pickering
@clem_pickering

Traditional challenges with
test environments
Lack of…
Access to…
Difference to live
Difference to each other
Performance of…
Speed of Provisioning

Added Agile Challenges
Frequency (Often)
NFRs (Early)
Empowerment (?)

Arghhh… Extra DevOps challenges
They want to deploy how often ?!! And did you say Live?

But what if it shouldn’t
be that hard?
Continuous Delivery is
an achievable and
worthwhile goal
Test environments are a
crucial part of the pipe
to live

Environments to support the pipeline to live
Local
environments
System &
Integration
Test
Performance
Labs
Pre-Prod Live

Examples from Callcredit
Build machines from scratch nightly
Self-serve private cloud for SIT
Dedicated easily shared Perf labs
Scripted builds for servers

Pre-Production still a bottleneck
Differences between environments
Lack of automated deployments
Teams still lack full control and ownership

The trouble with Pre-Prod
Silo’d from live
Like live, but not live
Expensive (and wasteful?)
Another deployment
“Not our problem”

Q. What’s the most live
we can get?
A. Live
Definition of live
Virtualisation
Load-balancing
Configuration

Test environments…
Provide many challenges but are
more important than ever…
Are part of a pipeline to live
Can be managed with
DevOps principles
Should be owned as a
whole and not in silos

TL;DR version:
Test environments are crucial in the pipeline to live
If Pre-Prod is supposed to be like live but never is,
maybe it’s time to use live

Condivideremo esperienze reali tratte da progetti dove applichiamo pratiche di Continous Delivery. Racconteremo di come si può far evolvere iterativamente una pipeline partendo da semplici task (build e deploy mono-ambiente) fino ad arrivare ad unica pipeline multi-ambiente ispirata allo stato dell’arte e alle lezioni che abbiamo imparato facendoci del male. Forniremo esempi concreti, focalizzandoci sugli aspetti relativi al codice, all’infrastruttura e rapporto con gli stakeholders.

Arquillian: Helping web developers and QA get along

Lukáš Fryč

Modern development practices include testing our Web applications as a fundamental part of the application development lifecycle. Web UIs though can be particularly difficult to test with basic tools. Arquillian is an award-winning integration testing framework and Selenium WebDriver is an outstanding tool for UI test automation. Together they offer a base for high-quality tests. This session looks to the Arquillian Universe for help. Equipped with the Arquillian extensions - Drone, Graphene and Warp - we will show you tests that cover both client-side (REST) and server-rendered (JSF) web applications. With a single test it is now possible to assert state (both in the server and on the client) at arbitrary points within the request lifecycle! We will look at current best practices for how to achieve a rapid turnaround when doing test development by minimizing the effort required to write tests, and thereby increase productivity and thus making these tests future-proof. Additionally we will show tools and techniques that provide a separation of concerns between test authors (developers) and test automators (QA). How to execute a single test in both arbitrary server containers as well as arbitrary client browsers. And how it can enable us to run test suites in constrained environments like cloud-based continuous integration providers.

Testing JSF with Arquillian and Selenium

Lukáš Fryč

Testing of web applications is significant part of development cycle from perspective of both, application development and quality assurance. JSF concepts makes testing of applications simple by separation of concerns, but enforces employing of specific tools for testing business logic and user interface. Lukas covers testing pitas and introduce frameworks which make testing of JSF application a breeze and motivate developers to follow concepts of test-driven development.

DevOps - Transparency & Self Service

Anton Weiss

Performance Metrics for your Delivery Pipeline - Wolfgang Gottesheim

JAXLondon2014

RentvTimothy Tsvetkov

Discovery delivery 中国软件技术大会2011

Qiao Liang

Devopsdays.pl 2015 krzysztof_debski (2)

Krzysztof Debski

It is always tough to test a complex API comprehensively. The additional level of complexity brings us to the question “How can we validate that our API is working as intended?” In this talk I will explain how to use test driven development for APIs to solve this problem and even further how TDD can drive an API Design towards a more usable design. I will outline my practical approach with an implementation example based on django. And finally I will give you a brief summary of my lessons learned using this approach in customer projects.

Agileee 2012

Wiktor Żołnowski

Real Java EE Testing with Arquillian and ShrinkWrap

Dan Allen

Arquillian - Integration Testing Made Easy

JBUG London

Beyond TDD: Enabling Your Team to Continuously Deliver Software

Chris Weldon

Many project teams have adopted unit testing as a necessary step in their development process. Many more use a test-first approach to keep their code lean. Yet, far too often these teams still suffer from many of the same impediments: recurrent integration failures with other enterprise projects, slow feedback with the customer, and sluggish release cycles. With a languishing feedback loop, the enterprise continues to put increasing pressure on development teams to deliver. How does an aspiring agile team improve to meet the demands of the enterprise? Continuous integration is the next logical step for the team. In this talk, you’ll learn how continuous integration solves intra and inter-project integration issues without manual overhead, the value added by continuous integration, and how to leverage tools and processes to further improve the quality of your code. Finally, we discuss the gold standard of agile teams: continuous deployment. You’ll learn how continuous deployment helps close the feedback loop with your customers, increases visibility for your team, and standardizes the deployment process.

Generalization in Auto-Testing. How we put what we had into new Technological...

SQALab

How to Work Efficiently in a Hybrid Git-Perforce Environment

Perforce

PuppetConf 2016: Continuous Delivery and DevOps with Jenkins and Puppet Enter...

Puppet

Continuous Integration and Builds

Bhavin Javia

Test Dependencies and the Future of Build Acceleration

New York City College of Technology Computer Systems Technology Colloquium

With the proliferation of testing culture, many developers are facing new challenges. As projects are getting started, the focus may be on developing enough tests to maintain confidence that the code is correct. However, as developers write more and more tests, performance and repeatability become growing concerns for test suites. In our study of large open source software, we found that running tests took on average 41% of the total time needed to build each project – over 90% in those that took the longest to build. Unfortunately, typical techniques for accelerating test suites from literature (like running only a subset of tests, or running them in parallel) can’t be applied in practice safely, since tests may depend on each other. These dependencies are very hard to find and detect, posing a serious challenge to test and build acceleration. In this talk, I will present my recent research in automatically detecting and isolating these dependencies, enabling for significant, safe and sound build acceleration of up to 16x.

Monster Builds and How to Tame Them - Atlassian Summit 2010

Atlassian

Enabling Agile Testing Through Continuous Integration Agile2009

sstolberg

A Continuous Integration system is often considered one of the key elements involved in supporting an agile software development and testing environment. As a traditional software tester transitioning to an agile development environment it became clear to me that I would need to put this essential infrastructure in place and promote improved development practices in order to make the transition to agile testing possible. This experience report discusses a continuous integration implementation I led last year. The initial motivations for implementing continuous integration are discussed and a pre and post-assessment using Martin Fowler's "Practices of Continuous Integration" is provided along with the technical specifics of the implementation. The report concludes with a retrospective of my experiences implementing and promoting continuous integration within the context of agile testing.

Succesful testing-continuous-delivery-testnetHarald Rietman

End-to-end performance testing, profiling, and analysis at Redis

Filipe Oliveira

High-performance (as measured by sub-millisecond response time for queries) is a key characteristic of the Redis database, and it is one of the main reasons why Redis is the most popular key-value database in the world. To continue improving performance across all of the different Redis components, we've developed a framework for automatically triggering performance tests, telemetry gathering, profiling, and data visualization upon code commit. In this short presentation, we describe how this type of automation and "zero-touch" profiling scaled our ability to pursue performance regressions and to find opportunities to improve the efficiency of our code, helping us (as a company) to start shifting from a reactive to a more proactive performance mindset.

Testing in DevOps world

Moataz Nabil

Why your company loves to welcome change but sucks at accommodating it

Farooq Ali

Varnita/Bender Community projectdoina_morari

Perspektif tokoh pendidikan islam indonesiaMuhamad Fatih Rusydi

Access microscholarship program, moldova april-september, 2013 actvitiesdoina_morari

Week 3 - Western Expansion and Homestead ActJenSantry

What's hot

Continuous Integration, Continuous Quality, Continuous Delivery

John Ferguson Smart Limited

Agile Evolution

Mikalai Alimenkou

TDD for APIs @ Europython 2015, Bilbao by Michael Kuehne

Michael Kuehne-Schlinkert

Agileee 2012

Wiktor Żołnowski

Real Java EE Testing with Arquillian and ShrinkWrap

Dan Allen

Arquillian - Integration Testing Made Easy

JBUG London

Beyond TDD: Enabling Your Team to Continuously Deliver Software

Chris Weldon

Generalization in Auto-Testing. How we put what we had into new Technological...

SQALab

How to Work Efficiently in a Hybrid Git-Perforce Environment

Perforce

PuppetConf 2016: Continuous Delivery and DevOps with Jenkins and Puppet Enter...

Puppet

Continuous Integration and Builds

Bhavin Javia

Test Dependencies and the Future of Build Acceleration

New York City College of Technology Computer Systems Technology Colloquium

Monster Builds and How to Tame Them - Atlassian Summit 2010

Atlassian

Enabling Agile Testing Through Continuous Integration Agile2009

sstolberg

Succesful testing-continuous-delivery-testnetHarald Rietman

End-to-end performance testing, profiling, and analysis at Redis

Filipe Oliveira

Testing in DevOps world

Moataz Nabil

Why your company loves to welcome change but sucks at accommodating it

Farooq Ali

What's hot (18)

Continuous Integration, Continuous Quality, Continuous Delivery

Agile Evolution

TDD for APIs @ Europython 2015, Bilbao by Michael Kuehne

Agileee 2012

Real Java EE Testing with Arquillian and ShrinkWrap

Arquillian - Integration Testing Made Easy

Beyond TDD: Enabling Your Team to Continuously Deliver Software

Generalization in Auto-Testing. How we put what we had into new Technological...

How to Work Efficiently in a Hybrid Git-Perforce Environment

PuppetConf 2016: Continuous Delivery and DevOps with Jenkins and Puppet Enter...

Continuous Integration and Builds

Test Dependencies and the Future of Build Acceleration

Monster Builds and How to Tame Them - Atlassian Summit 2010

Enabling Agile Testing Through Continuous Integration Agile2009

Succesful testing-continuous-delivery-testnet

End-to-end performance testing, profiling, and analysis at Redis

Testing in DevOps world

Why your company loves to welcome change but sucks at accommodating it

Viewers also liked

Varnita/Bender Community projectdoina_morari

Perspektif tokoh pendidikan islam indonesiaMuhamad Fatih Rusydi

Access microscholarship program, moldova april-september, 2013 actvitiesdoina_morari

Week 3 - Western Expansion and Homestead ActJenSantry

SEICEM - Francesco Belcastro

ANIE Energia

Directory structure for large meteor apps

exponential_io

Varnita-Bender Community Projectdoina_morari

The game of things (Access Chisinau)doina_morari

Mix Me

Sergey Rudnyaev

새로운 것들은 들이대면 나온다. 이명관

GNTECH_ceomba

Селекция

KuklinaGL

Swetha Bday PPTKavya Gollavilli

เอกสารประกอบการเรียน เรื่อง พลังงานแสงและระบบสุริยะ

Kan Pan

Apartamentos, Condos for Sale & Rent in Miami - Le Parc at Brickell

LEPARC AT BRICKELL

Motori elettrici ad alto rendimentoANIE Energia

Useful websites

Ramanand Kalathingal

Access is Moldovadoina_morari

Native American Foodsheds - Guest Speaker Brian PottsJenSantry

Viewers also liked (18)

Varnita/Bender Community project

Perspektif tokoh pendidikan islam indonesia

Access microscholarship program, moldova april-september, 2013 actvities

Week 3 - Western Expansion and Homestead Act

SEICEM - Francesco Belcastro

Directory structure for large meteor apps

Varnita-Bender Community Project

The game of things (Access Chisinau)

Mix Me

새로운 것들은 들이대면 나온다. 이명관

Селекция

Swetha Bday PPT

เอกสารประกอบการเรียน เรื่อง พลังงานแสงและระบบสุริยะ

Apartamentos, Condos for Sale & Rent in Miami - Le Parc at Brickell

Motori elettrici ad alto rendimento

Useful websites

Access is Moldova

Native American Foodsheds - Guest Speaker Brian Potts

Similar to Test Environments for Continuous Delivery

Continuous Testing

jaredrrichardson

Soasta | CloudBees webinar 11/12/2015

SOASTA

How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...

Jennifer Finney

Continuous delivery its not about the technology, its about the people. @pipe...

Tomas Riha

The Evolution of Agile - Continuous Delivery - Extending Agile out to Product...

Burns Sheehan

Continuous Delivery Testing @HiQ

Tomas Riha

Continuous delivery its not about the technology, its about the people. @sats...

Tomas Riha

Battle for Code Quality - A Story of One Java Project

GlobalLogic Ukraine

DevOpsMatthew Jones

DevOps in an Embedded World

Sajeewa Dayaratne

Scaling continuous delivery @ GeeCon 2014

Tomas Riha

Beyond Unit TestingSøren Lund

Continuous Load Testing with CloudTest and Jenkins

SOASTA

Two key challenges to continuous load testing are provisioning a test system to handle the load and accessing load generators to drive the traffic. In this webinar from SOASTA & CloudBees, you will learn how to: Build realistic automated web performance tests and run them in Jenkins Architect and launch a test environment that auto-provisions in the cloud Manage a load generation grid to drive load tests in a lights-out mode Establish a performance baseline in your daily Jenkins reports

Testing & Integration (The Remix)

Ines Sombra

Given at CraftConf 2015: http://craft-conf.com/2015 Accompanying talk repo: https://github.com/randommood/Craftconf2015 Video: http://www.ustream.tv/recorded/61449003 Let's face it, testing distributed systems is hard. Large number of inputs, partial failures, and asynchrony make these systems seemingly impossible to verify. Formal testing methods are onerous and system correctness continues to elude us. Despite the difficulty, we need to have a way to change our systems with confidence. Integration and unit tests are vital to our sanity and we know it's good for us to use continuous integration to ensure functional consistency across our products. Come to this talk for a fresh and practical look into the various aspects of distributed systems testing and integration. We will cover CI pipelines: their strengths, weaknesses, and ways to improvement them. Get ready to rediscover the untapped power of your integration practices and develop a burning desire to make them more awesome!

[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps

KMS Technology

DevOps is a spectacular mish-mash of development and operations processes and practices that has been growing increasingly popular in recent years. With the upward trending rate in adoption comes the need for organizations to fully understand the key practices as well as thoroughly integrating team members, especially testers, throughout the delivery pipeline. Getting started with DevOps practices can be a little tricky when choosing the right tools, people, and processes. In this webinar, we’ll focus on helping you make the switch without diminishing the team’s delivered product quality, so that the transition meets the enterprise objectives of speed and reliability. Tune in to learn: The biggest concern when moving to DevOps - and how to handle it Why you need ‘Coding Testers’ The best tools for the job The process of failing fast, and its significance to testers Measuring the transition - recommended metrics The value of DevOps long-term - efficiency, repeatability & reliability Don’t worry about failing - it’s a part of the process!

DevTestOps

Paul Mateos

Introduction to DevOps

PRATYUSH SINHA

Selenium Frameworks

Dave Haeffner

Continuous delivery @åf consultTomas Riha

Continuous Load Testing with CloudTest and Jenkins

SOASTA

Similar to Test Environments for Continuous Delivery (20)

Continuous Testing

Soasta | CloudBees webinar 11/12/2015

How To Introduce Cloud Based Load Testing to Your Jenkins Continuous Delivery...

Continuous delivery its not about the technology, its about the people. @pipe...

The Evolution of Agile - Continuous Delivery - Extending Agile out to Product...

Continuous Delivery Testing @HiQ

Continuous delivery its not about the technology, its about the people. @sats...

Battle for Code Quality - A Story of One Java Project

DevOps

DevOps in an Embedded World

Scaling continuous delivery @ GeeCon 2014

Beyond Unit Testing

Continuous Load Testing with CloudTest and Jenkins

Testing & Integration (The Remix)

[Webinar] Test First, Fail Fast - Simplifying the Tester's Transition to DevOps

DevTestOps

Introduction to DevOps

Selenium Frameworks

Continuous delivery @åf consult

Continuous Load Testing with CloudTest and Jenkins

Recently uploaded

FIDO Alliance Osaka Seminar: Overview.pdf

FIDO Alliance

Transcript: Selling digital books in 2024: Insights from industry leaders - T...

BookNet Canada

The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more. Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/ Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.

State of ICS and IoT Cyber Threat Landscape Report 2024 preview

Prayukth K V

The IoT and OT threat landscape report has been prepared by the Threat Research Team at Sectrio using data from Sectrio, cyber threat intelligence farming facilities spread across over 85 cities around the world. In addition, Sectrio also runs AI-based advanced threat and payload engagement facilities that serve as sinks to attract and engage sophisticated threat actors, and newer malware including new variants and latent threats that are at an earlier stage of development. The latest edition of the OT/ICS and IoT security Threat Landscape Report 2024 also covers: State of global ICS asset and network exposure Sectoral targets and attacks as well as the cost of ransom Global APT activity, AI usage, actor and tactic profiles, and implications Rise in volumes of AI-powered cyberattacks Major cyber events in 2024 Malware and malicious payload trends Cyberattack types and targets Vulnerability exploit attempts on CVEs Attacks on counties – USA Expansion of bot farms – how, where, and why In-depth analysis of the cyber threat landscape across North America, South America, Europe, APAC, and the Middle East Why are attacks on smart factories rising? Cyber risk predictions Axis of attacks – Europe Systemic attacks in the Middle East Download the full report from here: https://sectrio.com/resources/ot-threat-landscape-reports/sectrio-releases-ot-ics-and-iot-security-threat-landscape-report-2024/

From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...

Product School

DevOps and Testing slides at DASA Connect

Kari Kakkonen

FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf

FIDO Alliance

Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...

Jeffrey Haguewood

Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows. We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases. This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams. Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.

Bits & Pixels using AI for Good.........

Alison B. Lowndes

LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...

DanBrown980551

Do you want to learn how to model and simulate an electrical network from scratch in under an hour? Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)! During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook. PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides: - A fully editable and extendable library for grid component modelling; - Visualization tools to display your network; - Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses; The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well. What you will learn during the webinar: - For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills; - For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.

De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...

Product School

Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...

Product School

Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024

Tobias Schneck

As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other? Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.

Leading Change strategies and insights for effective change management pdf 1.pdf

OnBoard

Neuro-symbolic is not enough, we need neuro-*semantic*

Frank van Harmelen

Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”. All of this illustrated with link prediction over knowledge graphs, but the argument is general.

When stars align: studies in data quality, knowledge graphs, and machine lear...

Elena Simperl

UiPath Test Automation using UiPath Test Suite series, part 3

DianaGray10

Epistemic Interaction - tuning interfaces to provide information for AI support

Alan Dix

Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024 https://alandix.com/academic/papers/synergy2024-epistemic/ As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf

FIDO Alliance

AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...

Product School

UiPath Test Automation using UiPath Test Suite series, part 4

DianaGray10

Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap. The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies. Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques What will you get from this session? 1. Insights into SAP testing best practices 2. Heatmap utilization for testing 3. Optimization of testing processes 4. Demo Topics covered: Execution from the test manager Orchestrator execution result Defect reporting SAP heatmap example with demo Speaker: Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP

Recently uploaded (20)

FIDO Alliance Osaka Seminar: Overview.pdf

Transcript: Selling digital books in 2024: Insights from industry leaders - T...

State of ICS and IoT Cyber Threat Landscape Report 2024 preview

From Daily Decisions to Bottom Line: Connecting Product Work to Revenue by VP...

DevOps and Testing slides at DASA Connect

FIDO Alliance Osaka Seminar: Passkeys and the Road Ahead.pdf

Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...

Bits & Pixels using AI for Good.........

LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...

De-mystifying Zero to One: Design Informed Techniques for Greenfield Innovati...

Unsubscribed: Combat Subscription Fatigue With a Membership Mentality by Head...

Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024

Leading Change strategies and insights for effective change management pdf 1.pdf

Neuro-symbolic is not enough, we need neuro-*semantic*

When stars align: studies in data quality, knowledge graphs, and machine lear...

UiPath Test Automation using UiPath Test Suite series, part 3

Epistemic Interaction - tuning interfaces to provide information for AI support

FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf

AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...

UiPath Test Automation using UiPath Test Suite series, part 4

Test Environments for Continuous Delivery

3. Clem Pickering clement.pickering@callcreditgroup.com Clement Pickering @clem_pickering

4. Traditional challenges with test environments Lack of… Access to… Difference to live Difference to each other Performance of… Speed of Provisioning

5. Added Agile Challenges Frequency (Often) NFRs (Early) Empowerment (?)

6. Arghhh… Extra DevOps challenges They want to deploy how often ?!! And did you say Live?

7. But what if it shouldn’t be that hard? Continuous Delivery is an achievable and worthwhile goal Test environments are a crucial part of the pipe to live

8. Environments to support the pipeline to live Local environments System & Integration Test Performance Labs Pre-Prod Live

9. Examples from Callcredit Build machines from scratch nightly Self-serve private cloud for SIT Dedicated easily shared Perf labs Scripted builds for servers

10. Pre-Production still a bottleneck Differences between environments Lack of automated deployments Teams still lack full control and ownership

11. The trouble with Pre-Prod Silo’d from live Like live, but not live Expensive (and wasteful?) Another deployment “Not our problem”

12. Q. What’s the most live we can get? A. Live Definition of live Virtualisation Load-balancing Configuration

13. Test environments… Provide many challenges but are more important than ever… Are part of a pipeline to live Can be managed with DevOps principles Should be owned as a whole and not in silos

14. TL;DR version: Test environments are crucial in the pipeline to live If Pre-Prod is supposed to be like live but never is, maybe it’s time to use live

Editor's Notes

20 minute presentation, whinging about test environments (oh so easy) Test environments are everyone’s favourite scapegoats Overview presentation not a deep dive. Key aims to explore how test environments support an increasingly regular delivery to live and how to overcome some of the challenges
Head of Testing at Callcredit … and DevOps
Old school environment problems occur regardless Survey?
Agile brings challenges on top of the traditional
DevOps necessitates you can’t have a problem with test environments
To achieve continuous delivery environments need to be slick, and problems eradicated
Pre-prod is supposed to allow “as live” or “live like” testing – but is rarely like live We invest loads into trying to keep pre-prod like live but seldom achieve this

Test Environments for Continuous Delivery

Recommended

Recommended

More Related Content

What's hot

What's hot (18)

Viewers also liked

Viewers also liked (18)

Similar to Test Environments for Continuous Delivery

Similar to Test Environments for Continuous Delivery (20)

More from Clement Pickering

More from Clement Pickering (6)

Recently uploaded

Recently uploaded (20)

Test Environments for Continuous Delivery

Editor's Notes