SlideShare a Scribd company logo
1 of 30
Download to read offline
Why You Should Be Testing In Production
http://unsplash.com
Director/Quality Engineering
Greg Sypolt
110NewsMarkets
@gregsypolt
in/gregsypolt
Blogger Speaker
Conference
greg@qualityelement.com
</QUALITYELEMENT.COM>
What Are We Talking About Today?
http://unsplash.com
Testing In Production, Why?
Before Shifting Right, You Must Go Left
What Are The Advantages of Testing in Production?
What Are the Risks?
Potential Testing in Production Tactics
Traditional Strategies Won’t Cut It
Testing In Production, Why?
http://unsplash.com
Allows you to see how an application
reacts to newly pushed code change in the
wild 👍 🔥 ☠
Testing In Production, Why?
Significant component of your future
application quality strategy going forward
Testing In Production, Why?
Testing in production, builds another level of
confidence in releases after performing
various quality checks in live production
environment 💯 💰
Testing In Production, Why?
Before Shifting Right, You Must Go Left
http://unsplash.com
We should continue to shift left with testing
at every stage of the pipeline that enables
faster feedback from testing and integrating
code
Shift-Left
Shift-RIGHT
Before Shifting Right, You Must Go Left
Ask Yourself: What Are the Advantages of Testing in Production?
http://unsplash.com
The big difference here is changing the norm
by extending the continuous testing
feedback loop from live production data and
real user traffic while performing tests in
production
Ask Yourself: What Are the Advantages of Testing in Production?
You will find a collection of defect bugs not
found from other testing environment
activities (dev, staging, or pre-prod)
Ask Yourself: What Are the Advantages of Testing in Production?
The goal is to elevate quality by building
various quality guards around the
application
Ask Yourself: What Are the Advantages of Testing in Production?
Advantages of testing in a production
environment
Risk
elim
inate
Data
Ask Yourself: What Are the Advantages of Testing in Production?
What Are the Risks?
http://unsplash.com
The risk ultimately hinges on the
infrastructure design. Was it well thought-
out? Is it repeatable and disposable?
What Are the Risks?
If not, any of these possible outcomes could
occur with or without testing in production
What Are the Risks?
Take a moment to understand the following
DevOps terminology
vs.
What Are the Risks?
Potential Testing in Production Tactics
http://unsplash.com
The goal of testing is to prevent bugs from
being deployed to production
Potential Testing in Production Tactics
Deployment Strategies
Potential Testing in Production Tactics
Blue Green Deployment
Canary Releases
A / B Testing
Auto Rollback Strategy
Potential Testing in Production Tactics
Blue Green Deployments
v1.0
v1.1
web server app server database
router
idle
live
Potential Testing in Production Tactics
Canary Releases
v1.0
v1.1
router
Potential Testing in Production Tactics
A / B Testing
50% vistors see variation A
50% vistors see variation B
Rollback
Potential Testing in Production Tactics
Auto Rollback Strategy
fail
rollback
Release
Strategy
Deployment

Validation
Canary
Blue Green
Rolling
Availability

Performance

Logs

Quality

Security

More…
Continuous Integration
Continuous Delivery
Testing in Production Methods
New Relic Synthetic User Testing
Visual Testing with Applitools
Disaster Recovery Testing
Lightweight User Acceptance Testing
Infrastructure Testing
Potential Testing in Production Tactics
Application Monitoring
Traditional Strategies Won’t Cut It
Traditional Strategies Won’t Cut It
http://unsplash.com
Testing in production should be part of a
well-designed, scalable and highly resilient
testing routine
Potential Testing in Production Tactics
Questions
http://unsplash.com
Greg Sypolt
greg@qualityelement.com
</QUALITYELEMENT.COM>
in/gregsypolt
@gregsypolt

More Related Content

What's hot

Visual Studio Mobile Center: A story about mobile DevOps
Visual Studio Mobile Center: A story about mobile DevOpsVisual Studio Mobile Center: A story about mobile DevOps
Visual Studio Mobile Center: A story about mobile DevOpsGeert van der Cruijsen
 
Seven testing principles
Seven testing principlesSeven testing principles
Seven testing principlesVaibhav Dash
 
Overcoming The Challenges Faced in Exploratory Testing
Overcoming The Challenges Faced in Exploratory TestingOvercoming The Challenges Faced in Exploratory Testing
Overcoming The Challenges Faced in Exploratory TestingSarah Elson
 
Bringing Quality Design Systems to Life with Storybook & Applitools
Bringing Quality Design Systems to Life with Storybook & ApplitoolsBringing Quality Design Systems to Life with Storybook & Applitools
Bringing Quality Design Systems to Life with Storybook & ApplitoolsApplitools
 
Presentation - Test Automation in Digital Transformation - IITPSA SIGIST 2016042
Presentation - Test Automation in Digital Transformation - IITPSA SIGIST 2016042Presentation - Test Automation in Digital Transformation - IITPSA SIGIST 2016042
Presentation - Test Automation in Digital Transformation - IITPSA SIGIST 2016042Wayne Sinclair
 
Sauce Labs Webinar: Rising Importance of Software Testing
Sauce Labs Webinar: Rising Importance of Software TestingSauce Labs Webinar: Rising Importance of Software Testing
Sauce Labs Webinar: Rising Importance of Software TestingSauce Labs
 
Testing Metrics - Making your tests visible
Testing Metrics - Making your tests visibleTesting Metrics - Making your tests visible
Testing Metrics - Making your tests visibleAlper Mermer
 
Performance Testing – Look Before you Leap
Performance Testing – Look Before you LeapPerformance Testing – Look Before you Leap
Performance Testing – Look Before you LeapSoftware Testing Solution
 
How Lean Is Your Software Testing?
How Lean Is Your Software Testing?How Lean Is Your Software Testing?
How Lean Is Your Software Testing?Rosie Sherry
 
Test automation - What? Why? How?
Test automation - What? Why? How?Test automation - What? Why? How?
Test automation - What? Why? How?Anand Bagmar
 
Machine learning in software testing
Machine learning in software testingMachine learning in software testing
Machine learning in software testingThoughtworks
 
QASymphony and TestPlant: Bringing Together Best-in-Class Test Management and...
QASymphony and TestPlant: Bringing Together Best-in-Class Test Management and...QASymphony and TestPlant: Bringing Together Best-in-Class Test Management and...
QASymphony and TestPlant: Bringing Together Best-in-Class Test Management and...QASymphony
 
Principles of Software testing
Principles of Software testingPrinciples of Software testing
Principles of Software testingMd Mamunur Rashid
 
Automated testing of software applications using machine learning edited
Automated testing of software applications using machine learning   editedAutomated testing of software applications using machine learning   edited
Automated testing of software applications using machine learning editedMilind Kelkar
 
FADHILLA ELITA Ppt Chapter 1
FADHILLA ELITA Ppt Chapter 1FADHILLA ELITA Ppt Chapter 1
FADHILLA ELITA Ppt Chapter 1fadhilla elita
 
Move test planning before implementation
Move test planning before implementationMove test planning before implementation
Move test planning before implementationTed Cheng
 
Developer testing webinar
Developer testing webinar Developer testing webinar
Developer testing webinar PractiTest
 

What's hot (20)

Visual Studio Mobile Center: A story about mobile DevOps
Visual Studio Mobile Center: A story about mobile DevOpsVisual Studio Mobile Center: A story about mobile DevOps
Visual Studio Mobile Center: A story about mobile DevOps
 
Seven testing principles
Seven testing principlesSeven testing principles
Seven testing principles
 
Overcoming The Challenges Faced in Exploratory Testing
Overcoming The Challenges Faced in Exploratory TestingOvercoming The Challenges Faced in Exploratory Testing
Overcoming The Challenges Faced in Exploratory Testing
 
Bringing Quality Design Systems to Life with Storybook & Applitools
Bringing Quality Design Systems to Life with Storybook & ApplitoolsBringing Quality Design Systems to Life with Storybook & Applitools
Bringing Quality Design Systems to Life with Storybook & Applitools
 
Treinamento TDD
Treinamento TDDTreinamento TDD
Treinamento TDD
 
Presentation - Test Automation in Digital Transformation - IITPSA SIGIST 2016042
Presentation - Test Automation in Digital Transformation - IITPSA SIGIST 2016042Presentation - Test Automation in Digital Transformation - IITPSA SIGIST 2016042
Presentation - Test Automation in Digital Transformation - IITPSA SIGIST 2016042
 
Sauce Labs Webinar: Rising Importance of Software Testing
Sauce Labs Webinar: Rising Importance of Software TestingSauce Labs Webinar: Rising Importance of Software Testing
Sauce Labs Webinar: Rising Importance of Software Testing
 
Testing Metrics - Making your tests visible
Testing Metrics - Making your tests visibleTesting Metrics - Making your tests visible
Testing Metrics - Making your tests visible
 
Performance Testing – Look Before you Leap
Performance Testing – Look Before you LeapPerformance Testing – Look Before you Leap
Performance Testing – Look Before you Leap
 
How Lean Is Your Software Testing?
How Lean Is Your Software Testing?How Lean Is Your Software Testing?
How Lean Is Your Software Testing?
 
Principles of software testing
Principles of software testingPrinciples of software testing
Principles of software testing
 
Test automation - What? Why? How?
Test automation - What? Why? How?Test automation - What? Why? How?
Test automation - What? Why? How?
 
Machine learning in software testing
Machine learning in software testingMachine learning in software testing
Machine learning in software testing
 
QASymphony and TestPlant: Bringing Together Best-in-Class Test Management and...
QASymphony and TestPlant: Bringing Together Best-in-Class Test Management and...QASymphony and TestPlant: Bringing Together Best-in-Class Test Management and...
QASymphony and TestPlant: Bringing Together Best-in-Class Test Management and...
 
Principles of Software testing
Principles of Software testingPrinciples of Software testing
Principles of Software testing
 
Automated testing of software applications using machine learning edited
Automated testing of software applications using machine learning   editedAutomated testing of software applications using machine learning   edited
Automated testing of software applications using machine learning edited
 
FADHILLA ELITA Ppt Chapter 1
FADHILLA ELITA Ppt Chapter 1FADHILLA ELITA Ppt Chapter 1
FADHILLA ELITA Ppt Chapter 1
 
Move test planning before implementation
Move test planning before implementationMove test planning before implementation
Move test planning before implementation
 
Developer testing webinar
Developer testing webinar Developer testing webinar
Developer testing webinar
 
I dream of ISPWeb
I dream of ISPWebI dream of ISPWeb
I dream of ISPWeb
 

Similar to Why You Should Be Testing in Production: The Advantages and Risks

The DevOps Dance - Shift Left, Shift Right - Get It Right
The DevOps Dance - Shift Left, Shift Right - Get It RightThe DevOps Dance - Shift Left, Shift Right - Get It Right
The DevOps Dance - Shift Left, Shift Right - Get It RightInflectra
 
What is Shift Left Testing.pdf
What is Shift Left Testing.pdfWhat is Shift Left Testing.pdf
What is Shift Left Testing.pdfTestbytes
 
Continuous Testing - The Final Frontier
Continuous Testing - The Final FrontierContinuous Testing - The Final Frontier
Continuous Testing - The Final FrontierJaco Greyling
 
Continuous Delivery Testing @HiQ
Continuous Delivery Testing @HiQContinuous Delivery Testing @HiQ
Continuous Delivery Testing @HiQTomas Riha
 
XebiaLabs & codecentric Webinar: Deploy Higher Quality Applications Faster (G...
XebiaLabs & codecentric Webinar: Deploy Higher Quality Applications Faster (G...XebiaLabs & codecentric Webinar: Deploy Higher Quality Applications Faster (G...
XebiaLabs & codecentric Webinar: Deploy Higher Quality Applications Faster (G...XebiaLabs
 
The Significance of Regression Testing in Software Development.pdf
The Significance of Regression Testing in Software Development.pdfThe Significance of Regression Testing in Software Development.pdf
The Significance of Regression Testing in Software Development.pdfRohitBhandari66
 
"Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry""Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry"Applitools
 
Finding the important bugs- A talk by John Scarborough, Director of Testing, ...
Finding the important bugs- A talk by John Scarborough, Director of Testing, ...Finding the important bugs- A talk by John Scarborough, Director of Testing, ...
Finding the important bugs- A talk by John Scarborough, Director of Testing, ...HARMAN Services
 
The Definitive Guide to Implementing Shift Left Testing in QA
The Definitive Guide to Implementing Shift Left Testing in QAThe Definitive Guide to Implementing Shift Left Testing in QA
The Definitive Guide to Implementing Shift Left Testing in QARapidValue
 
Continuous delivery its not about the technology, its about the people.
Continuous delivery its not about the technology, its about the people.Continuous delivery its not about the technology, its about the people.
Continuous delivery its not about the technology, its about the people.Tomas Riha
 
What Key Features Lead to Successful Continuous Testing and its Benefits.pdf
What Key Features Lead to Successful Continuous Testing and its Benefits.pdfWhat Key Features Lead to Successful Continuous Testing and its Benefits.pdf
What Key Features Lead to Successful Continuous Testing and its Benefits.pdfpCloudy
 
Ready, Set, Shop! The Pressure is on For Your Applications to Perform Flawl...
Ready, Set, Shop! The Pressure is on For Your Applications to Perform Flawl...Ready, Set, Shop! The Pressure is on For Your Applications to Perform Flawl...
Ready, Set, Shop! The Pressure is on For Your Applications to Perform Flawl...CA Technologies
 
Enhancing Software Quality
Enhancing Software QualityEnhancing Software Quality
Enhancing Software QualityAnand Prabhala
 
How to Measure Success in Continuous Testing by Fernando Vidal and Amir Rozen...
How to Measure Success in Continuous Testing by Fernando Vidal and Amir Rozen...How to Measure Success in Continuous Testing by Fernando Vidal and Amir Rozen...
How to Measure Success in Continuous Testing by Fernando Vidal and Amir Rozen...Sauce Labs
 
EXTENT-2016: The Future of Software Testing
EXTENT-2016:	 The Future of Software TestingEXTENT-2016:	 The Future of Software Testing
EXTENT-2016: The Future of Software TestingIosif Itkin
 
Testing Essentials for the Age of Agile
Testing Essentials for the Age of AgileTesting Essentials for the Age of Agile
Testing Essentials for the Age of AgileApplause
 
Software Testing Principles
Software Testing PrinciplesSoftware Testing Principles
Software Testing PrinciplesKanoah
 
Why Software Testing is Crucial in Software Development_.pdf
Why Software Testing is Crucial in Software Development_.pdfWhy Software Testing is Crucial in Software Development_.pdf
Why Software Testing is Crucial in Software Development_.pdfXDuce Corporation
 

Similar to Why You Should Be Testing in Production: The Advantages and Risks (20)

The DevOps Dance - Shift Left, Shift Right - Get It Right
The DevOps Dance - Shift Left, Shift Right - Get It RightThe DevOps Dance - Shift Left, Shift Right - Get It Right
The DevOps Dance - Shift Left, Shift Right - Get It Right
 
What is Shift Left Testing.pdf
What is Shift Left Testing.pdfWhat is Shift Left Testing.pdf
What is Shift Left Testing.pdf
 
Continuous Testing - The Final Frontier
Continuous Testing - The Final FrontierContinuous Testing - The Final Frontier
Continuous Testing - The Final Frontier
 
Future of QA
Future of QAFuture of QA
Future of QA
 
Futureofqa
FutureofqaFutureofqa
Futureofqa
 
Continuous Delivery Testing @HiQ
Continuous Delivery Testing @HiQContinuous Delivery Testing @HiQ
Continuous Delivery Testing @HiQ
 
XebiaLabs & codecentric Webinar: Deploy Higher Quality Applications Faster (G...
XebiaLabs & codecentric Webinar: Deploy Higher Quality Applications Faster (G...XebiaLabs & codecentric Webinar: Deploy Higher Quality Applications Faster (G...
XebiaLabs & codecentric Webinar: Deploy Higher Quality Applications Faster (G...
 
The Significance of Regression Testing in Software Development.pdf
The Significance of Regression Testing in Software Development.pdfThe Significance of Regression Testing in Software Development.pdf
The Significance of Regression Testing in Software Development.pdf
 
"Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry""Software Quality in the Service of Innovation in the Insurance Industry"
"Software Quality in the Service of Innovation in the Insurance Industry"
 
Finding the important bugs- A talk by John Scarborough, Director of Testing, ...
Finding the important bugs- A talk by John Scarborough, Director of Testing, ...Finding the important bugs- A talk by John Scarborough, Director of Testing, ...
Finding the important bugs- A talk by John Scarborough, Director of Testing, ...
 
The Definitive Guide to Implementing Shift Left Testing in QA
The Definitive Guide to Implementing Shift Left Testing in QAThe Definitive Guide to Implementing Shift Left Testing in QA
The Definitive Guide to Implementing Shift Left Testing in QA
 
Continuous delivery its not about the technology, its about the people.
Continuous delivery its not about the technology, its about the people.Continuous delivery its not about the technology, its about the people.
Continuous delivery its not about the technology, its about the people.
 
What Key Features Lead to Successful Continuous Testing and its Benefits.pdf
What Key Features Lead to Successful Continuous Testing and its Benefits.pdfWhat Key Features Lead to Successful Continuous Testing and its Benefits.pdf
What Key Features Lead to Successful Continuous Testing and its Benefits.pdf
 
Ready, Set, Shop! The Pressure is on For Your Applications to Perform Flawl...
Ready, Set, Shop! The Pressure is on For Your Applications to Perform Flawl...Ready, Set, Shop! The Pressure is on For Your Applications to Perform Flawl...
Ready, Set, Shop! The Pressure is on For Your Applications to Perform Flawl...
 
Enhancing Software Quality
Enhancing Software QualityEnhancing Software Quality
Enhancing Software Quality
 
How to Measure Success in Continuous Testing by Fernando Vidal and Amir Rozen...
How to Measure Success in Continuous Testing by Fernando Vidal and Amir Rozen...How to Measure Success in Continuous Testing by Fernando Vidal and Amir Rozen...
How to Measure Success in Continuous Testing by Fernando Vidal and Amir Rozen...
 
EXTENT-2016: The Future of Software Testing
EXTENT-2016:	 The Future of Software TestingEXTENT-2016:	 The Future of Software Testing
EXTENT-2016: The Future of Software Testing
 
Testing Essentials for the Age of Agile
Testing Essentials for the Age of AgileTesting Essentials for the Age of Agile
Testing Essentials for the Age of Agile
 
Software Testing Principles
Software Testing PrinciplesSoftware Testing Principles
Software Testing Principles
 
Why Software Testing is Crucial in Software Development_.pdf
Why Software Testing is Crucial in Software Development_.pdfWhy Software Testing is Crucial in Software Development_.pdf
Why Software Testing is Crucial in Software Development_.pdf
 

Recently uploaded

Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksSoftradix Technologies
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Wonjun Hwang
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptxLBM Solutions
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersThousandEyes
 
costume and set research powerpoint presentation
costume and set research powerpoint presentationcostume and set research powerpoint presentation
costume and set research powerpoint presentationphoebematthew05
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsPrecisely
 
APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April  Automation LPDGAPIForce Zurich 5 April  Automation LPDG
APIForce Zurich 5 April Automation LPDGMarianaLemus7
 

Recently uploaded (20)

The transition to renewables in India.pdf
The transition to renewables in India.pdfThe transition to renewables in India.pdf
The transition to renewables in India.pdf
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort ServiceHot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
Hot Sexy call girls in Panjabi Bagh 🔝 9953056974 🔝 Delhi escort Service
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
Benefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other FrameworksBenefits Of Flutter Compared To Other Frameworks
Benefits Of Flutter Compared To Other Frameworks
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
Pigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping ElbowsPigging Solutions Piggable Sweeping Elbows
Pigging Solutions Piggable Sweeping Elbows
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
 
Key Features Of Token Development (1).pptx
Key  Features Of Token  Development (1).pptxKey  Features Of Token  Development (1).pptx
Key Features Of Token Development (1).pptx
 
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for PartnersEnhancing Worker Digital Experience: A Hands-on Workshop for Partners
Enhancing Worker Digital Experience: A Hands-on Workshop for Partners
 
costume and set research powerpoint presentation
costume and set research powerpoint presentationcostume and set research powerpoint presentation
costume and set research powerpoint presentation
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Unlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power SystemsUnlocking the Potential of the Cloud for IBM Power Systems
Unlocking the Potential of the Cloud for IBM Power Systems
 
APIForce Zurich 5 April Automation LPDG
APIForce Zurich 5 April  Automation LPDGAPIForce Zurich 5 April  Automation LPDG
APIForce Zurich 5 April Automation LPDG
 

Why You Should Be Testing in Production: The Advantages and Risks

  • 1. Why You Should Be Testing In Production http://unsplash.com
  • 2. Director/Quality Engineering Greg Sypolt 110NewsMarkets @gregsypolt in/gregsypolt Blogger Speaker Conference greg@qualityelement.com </QUALITYELEMENT.COM>
  • 3. What Are We Talking About Today? http://unsplash.com Testing In Production, Why? Before Shifting Right, You Must Go Left What Are The Advantages of Testing in Production? What Are the Risks? Potential Testing in Production Tactics Traditional Strategies Won’t Cut It
  • 4. Testing In Production, Why? http://unsplash.com
  • 5. Allows you to see how an application reacts to newly pushed code change in the wild 👍 🔥 ☠ Testing In Production, Why?
  • 6. Significant component of your future application quality strategy going forward Testing In Production, Why?
  • 7. Testing in production, builds another level of confidence in releases after performing various quality checks in live production environment 💯 💰 Testing In Production, Why?
  • 8. Before Shifting Right, You Must Go Left http://unsplash.com
  • 9. We should continue to shift left with testing at every stage of the pipeline that enables faster feedback from testing and integrating code Shift-Left Shift-RIGHT Before Shifting Right, You Must Go Left
  • 10. Ask Yourself: What Are the Advantages of Testing in Production? http://unsplash.com
  • 11. The big difference here is changing the norm by extending the continuous testing feedback loop from live production data and real user traffic while performing tests in production Ask Yourself: What Are the Advantages of Testing in Production?
  • 12. You will find a collection of defect bugs not found from other testing environment activities (dev, staging, or pre-prod) Ask Yourself: What Are the Advantages of Testing in Production?
  • 13. The goal is to elevate quality by building various quality guards around the application Ask Yourself: What Are the Advantages of Testing in Production?
  • 14. Advantages of testing in a production environment Risk elim inate Data Ask Yourself: What Are the Advantages of Testing in Production?
  • 15. What Are the Risks? http://unsplash.com
  • 16. The risk ultimately hinges on the infrastructure design. Was it well thought- out? Is it repeatable and disposable? What Are the Risks?
  • 17. If not, any of these possible outcomes could occur with or without testing in production What Are the Risks?
  • 18. Take a moment to understand the following DevOps terminology vs. What Are the Risks?
  • 19. Potential Testing in Production Tactics http://unsplash.com
  • 20. The goal of testing is to prevent bugs from being deployed to production Potential Testing in Production Tactics
  • 21. Deployment Strategies Potential Testing in Production Tactics Blue Green Deployment Canary Releases A / B Testing Auto Rollback Strategy
  • 22. Potential Testing in Production Tactics Blue Green Deployments v1.0 v1.1 web server app server database router idle live
  • 23. Potential Testing in Production Tactics Canary Releases v1.0 v1.1 router
  • 24. Potential Testing in Production Tactics A / B Testing 50% vistors see variation A 50% vistors see variation B
  • 25. Rollback Potential Testing in Production Tactics Auto Rollback Strategy fail rollback Release Strategy Deployment
 Validation Canary Blue Green Rolling Availability
 Performance
 Logs
 Quality
 Security
 More… Continuous Integration Continuous Delivery
  • 26. Testing in Production Methods New Relic Synthetic User Testing Visual Testing with Applitools Disaster Recovery Testing Lightweight User Acceptance Testing Infrastructure Testing Potential Testing in Production Tactics
  • 28. Traditional Strategies Won’t Cut It http://unsplash.com
  • 29. Testing in production should be part of a well-designed, scalable and highly resilient testing routine Potential Testing in Production Tactics