SlideShare a Scribd company logo
1 of 37
Powering Safe Launch @
Scale
July 26th, 2017
Adil Aijaz
CEO/Co-Founder @ Split
adil@split.io
ADIL AIJAZ
Moving fast, and slow, at different scales since 2006
Mission
To empower enterprises to build better software, faster.
Product
An intelligent software delivery platform for developers, product managers and
entire teams that enables safe launch, full-stack experimentation, and the dynamic
configuration of features.
About Us
● Founded in Redwood City, CA in 2015 by domain experts from Google,
LinkedIn, Salesforce, and Databricks
● Backed by Accel Partners and Lightspeed Ventures
Controlled Rollout & Experimentation
Software is being delivered faster than ever before
90% of world’s data was created in the last 2 years
Best software companies are
agile and have a culture of
experimentation
Agility
Biggest force enabling agility:
Continuous Delivery
Software continuously delivered
as small, iterative features
● Merging code into trunk on a daily basis.
● Having branches or forks with very short lifetimes -
less than a day.
● Having fewer than three active branches at any time.
Source: State of DevOps Report - 2016
Behaviors of “High Performance Teams”:
Any feature deployment could
break the product for all
customers
Continuous Risk:
Microsoft used an army of QA
engineers to solve this problem
Back in the 90s:
Modern teams use Safe Launch
Today:
Software continuously delivered
as small, iterative features to
subsets of customers …. then
gradually dialed out to all
customers
Rooted in feature flags, A/B
testing, and Dynamic
Configuration
Feature Flags
Mechanism to separate code
deploy from feature deploy.
if (feature on) {
// show feature
} else {
// do not show feature
}
Feature Flags + Targeting Engine
if (feature on for this customer) {
// show feature
} else {
// do not show feature
}
• Whitelisted Customers
• Scrum Team
• Employees
• Pilot Partners
• Customer Segments
• Trial Customers
• Geo Located Customers
• Revenue Based Targeting
• Percentages
• 20% of all customers
• 10% of Customers in
Austin
Launch Features to a
Targeted Set of
Customers
Kill Switch
• Agility
• Trunk-Based Development
• Customer Feedback Loop
• Quality
• Limits blast radius of
problems.
• Quality testing in production.
• Performance
• Stress test your systems
before GA
• Reduce cost of maintaining
perf labs.
• Security
• Avoid copying production data
to non-production
environments
Benefits
You can’t be agile nor practice
Continuous Delivery without
Safe Launch
Summary:
Experimentation
One of the goals of agile
development is to practice
customer-centric development
Start with an idea, launch
prototype to customers, measure
KPIs, then refine based on
feedback loop
Software delivered as small,
iterative features to subsets of
customers …. then measured for
impact on KPIs
See the similarities?
Safe Launch is about stability +
agility
Experimentation is about
optimization + stability + agility
Launch A Recommendation Algorithm
Safe Launch:
Did we negatively impact
any technical KPIs?
Experimentation:
Did we positively impact
business KPI while avoiding
negative impact on all
technical and business
KPIs?
Safe Launch & Experimentation
are two sides of the same coin
Safe Launch /
Stability / Agility
Experimentation
/ Optimization
Safe Launch /
Stability / Agility
Interplay of Safe Launch & Experimentation
- 10%
- 50%
- 100%
Experimentation is the frontier of
modern software development
Innovative Companies Build Safe Launch & Experimentation Platforms
Gatekeeper LiX
WebLabsUber XP
For additional meetup information, please
contact us on meetup@split.io
Thank you!

More Related Content

What's hot

Test Automation is for Everyone
Test Automation is for EveryoneTest Automation is for Everyone
Test Automation is for EveryoneWorksoft
 
BizDevOps – Delivering Business Value Quickly at Scale
BizDevOps – Delivering Business Value Quickly at ScaleBizDevOps – Delivering Business Value Quickly at Scale
BizDevOps – Delivering Business Value Quickly at ScaleQASymphony
 
Packaged vs. Custom Application Testing
Packaged vs. Custom Application TestingPackaged vs. Custom Application Testing
Packaged vs. Custom Application TestingWorksoft
 
ITIL® Release, Control and Validation
ITIL® Release, Control and ValidationITIL® Release, Control and Validation
ITIL® Release, Control and Validationmitchell burner
 
Measuring Software Quality as IT happens !
Measuring Software Quality as IT happens ! Measuring Software Quality as IT happens !
Measuring Software Quality as IT happens ! Ajay Emmanuel
 
How to Measure Agility Project Success in Business Terms
How to Measure Agility Project Success in Business TermsHow to Measure Agility Project Success in Business Terms
How to Measure Agility Project Success in Business TermsEthan Ram
 
Shift Left with Continuous Inspection
Shift Left with Continuous InspectionShift Left with Continuous Inspection
Shift Left with Continuous InspectionSerena Software
 
Introduction to Puppet Enterprise 2016.1
Introduction to Puppet Enterprise 2016.1Introduction to Puppet Enterprise 2016.1
Introduction to Puppet Enterprise 2016.1Puppet
 
Optimize your Development and/or Outsourcing for Modern Apps
Optimize your Development and/or Outsourcing for Modern AppsOptimize your Development and/or Outsourcing for Modern Apps
Optimize your Development and/or Outsourcing for Modern AppsSoftware Guru
 
Using Error Budgets to Prioritize Work
Using Error Budgets to Prioritize WorkUsing Error Budgets to Prioritize Work
Using Error Budgets to Prioritize WorkNathen Harvey
 
JDD2015: Migrating to continuous delivery in the world of financial trading -...
JDD2015: Migrating to continuous delivery in the world of financial trading -...JDD2015: Migrating to continuous delivery in the world of financial trading -...
JDD2015: Migrating to continuous delivery in the world of financial trading -...PROIDEA
 
Continuous delivery Krakow JDD 2015
Continuous delivery Krakow JDD 2015Continuous delivery Krakow JDD 2015
Continuous delivery Krakow JDD 2015David Genn
 
Devops Recto-Verso @ DevoxxMA
Devops Recto-Verso @ DevoxxMADevops Recto-Verso @ DevoxxMA
Devops Recto-Verso @ DevoxxMAArnaud Héritier
 
The New Age of Enterprise DevOps
The New Age of Enterprise DevOpsThe New Age of Enterprise DevOps
The New Age of Enterprise DevOpsXebiaLabs
 
Lights-Out Testing for Lights-On Business
Lights-Out Testing for Lights-On BusinessLights-Out Testing for Lights-On Business
Lights-Out Testing for Lights-On BusinessWorksoft
 
What's New with Worksoft Certify
What's New with Worksoft CertifyWhat's New with Worksoft Certify
What's New with Worksoft CertifyWorksoft
 
Continuous Integration Testing for SAP
Continuous Integration Testing for SAPContinuous Integration Testing for SAP
Continuous Integration Testing for SAPWorksoft
 
10 Steps to Shift Left - Guiding Principles in QA
10 Steps to Shift Left - Guiding Principles in QA10 Steps to Shift Left - Guiding Principles in QA
10 Steps to Shift Left - Guiding Principles in QAJim Spillson
 

What's hot (20)

Test Automation is for Everyone
Test Automation is for EveryoneTest Automation is for Everyone
Test Automation is for Everyone
 
BizDevOps – Delivering Business Value Quickly at Scale
BizDevOps – Delivering Business Value Quickly at ScaleBizDevOps – Delivering Business Value Quickly at Scale
BizDevOps – Delivering Business Value Quickly at Scale
 
Packaged vs. Custom Application Testing
Packaged vs. Custom Application TestingPackaged vs. Custom Application Testing
Packaged vs. Custom Application Testing
 
Agile talk
Agile talkAgile talk
Agile talk
 
ITIL® Release, Control and Validation
ITIL® Release, Control and ValidationITIL® Release, Control and Validation
ITIL® Release, Control and Validation
 
Measuring Software Quality as IT happens !
Measuring Software Quality as IT happens ! Measuring Software Quality as IT happens !
Measuring Software Quality as IT happens !
 
How to Measure Agility Project Success in Business Terms
How to Measure Agility Project Success in Business TermsHow to Measure Agility Project Success in Business Terms
How to Measure Agility Project Success in Business Terms
 
Shift Left with Continuous Inspection
Shift Left with Continuous InspectionShift Left with Continuous Inspection
Shift Left with Continuous Inspection
 
DevOps
DevOpsDevOps
DevOps
 
Introduction to Puppet Enterprise 2016.1
Introduction to Puppet Enterprise 2016.1Introduction to Puppet Enterprise 2016.1
Introduction to Puppet Enterprise 2016.1
 
Optimize your Development and/or Outsourcing for Modern Apps
Optimize your Development and/or Outsourcing for Modern AppsOptimize your Development and/or Outsourcing for Modern Apps
Optimize your Development and/or Outsourcing for Modern Apps
 
Using Error Budgets to Prioritize Work
Using Error Budgets to Prioritize WorkUsing Error Budgets to Prioritize Work
Using Error Budgets to Prioritize Work
 
JDD2015: Migrating to continuous delivery in the world of financial trading -...
JDD2015: Migrating to continuous delivery in the world of financial trading -...JDD2015: Migrating to continuous delivery in the world of financial trading -...
JDD2015: Migrating to continuous delivery in the world of financial trading -...
 
Continuous delivery Krakow JDD 2015
Continuous delivery Krakow JDD 2015Continuous delivery Krakow JDD 2015
Continuous delivery Krakow JDD 2015
 
Devops Recto-Verso @ DevoxxMA
Devops Recto-Verso @ DevoxxMADevops Recto-Verso @ DevoxxMA
Devops Recto-Verso @ DevoxxMA
 
The New Age of Enterprise DevOps
The New Age of Enterprise DevOpsThe New Age of Enterprise DevOps
The New Age of Enterprise DevOps
 
Lights-Out Testing for Lights-On Business
Lights-Out Testing for Lights-On BusinessLights-Out Testing for Lights-On Business
Lights-Out Testing for Lights-On Business
 
What's New with Worksoft Certify
What's New with Worksoft CertifyWhat's New with Worksoft Certify
What's New with Worksoft Certify
 
Continuous Integration Testing for SAP
Continuous Integration Testing for SAPContinuous Integration Testing for SAP
Continuous Integration Testing for SAP
 
10 Steps to Shift Left - Guiding Principles in QA
10 Steps to Shift Left - Guiding Principles in QA10 Steps to Shift Left - Guiding Principles in QA
10 Steps to Shift Left - Guiding Principles in QA
 

Similar to Powering Safe Launch @ Scale (Feature Flags, Targeting, Experimentation)

The quality assurance checklist for progressive testing
The quality assurance checklist for progressive testingThe quality assurance checklist for progressive testing
The quality assurance checklist for progressive testingMaitrikpaida
 
The Quality Assurance Checklist for Progressive Testing
The Quality Assurance Checklist for Progressive TestingThe Quality Assurance Checklist for Progressive Testing
The Quality Assurance Checklist for Progressive TestingCygnet Infotech
 
Agile Software Development Methodologies
Agile Software Development MethodologiesAgile Software Development Methodologies
Agile Software Development MethodologiesPradeep Patel, PMP®
 
Agile software development
Agile software developmentAgile software development
Agile software developmentpradeeppatelpmp
 
[India Merge World Tour] Coverity
[India Merge World Tour] Coverity[India Merge World Tour] Coverity
[India Merge World Tour] CoverityPerforce
 
Agile-plus-DevOps Testing for Packaged Applications
Agile-plus-DevOps Testing for Packaged ApplicationsAgile-plus-DevOps Testing for Packaged Applications
Agile-plus-DevOps Testing for Packaged ApplicationsWorksoft
 
A Comprehensive Step-by-Step Guide for Designing an Agile-Friendly Automation...
A Comprehensive Step-by-Step Guide for Designing an Agile-Friendly Automation...A Comprehensive Step-by-Step Guide for Designing an Agile-Friendly Automation...
A Comprehensive Step-by-Step Guide for Designing an Agile-Friendly Automation...Calidad Infotech
 
Enterprise QA and Application Testing Services
Enterprise QA and Application Testing ServicesEnterprise QA and Application Testing Services
Enterprise QA and Application Testing ServicesHemang Rindani
 
Enterprise QA and Application Testing Services
Enterprise QA and Application Testing ServicesEnterprise QA and Application Testing Services
Enterprise QA and Application Testing ServicesCygnet Infotech
 
How to Optimize Your Software Development Process for Maximum Efficiency.pdf
How to Optimize Your Software Development Process for Maximum Efficiency.pdfHow to Optimize Your Software Development Process for Maximum Efficiency.pdf
How to Optimize Your Software Development Process for Maximum Efficiency.pdfIT Service India
 
Application Lifecycle Management (ALM), by Marco Silva
Application Lifecycle Management (ALM), by Marco SilvaApplication Lifecycle Management (ALM), by Marco Silva
Application Lifecycle Management (ALM), by Marco SilvaAgile Connect®
 
Scrum Portugal Meeting 1 Lisbon - ALM
Scrum Portugal Meeting 1 Lisbon - ALMScrum Portugal Meeting 1 Lisbon - ALM
Scrum Portugal Meeting 1 Lisbon - ALMMarco Silva
 
Digital Disruption with DevOps - Reference Architecture Overview
Digital Disruption with DevOps - Reference Architecture OverviewDigital Disruption with DevOps - Reference Architecture Overview
Digital Disruption with DevOps - Reference Architecture OverviewIBM UrbanCode Products
 
DevOps in Salesforce AppCloud
DevOps in Salesforce AppCloudDevOps in Salesforce AppCloud
DevOps in Salesforce AppCloudrsg00usa
 
Enterprise Agile - Hybrid of Methods
Enterprise Agile - Hybrid of MethodsEnterprise Agile - Hybrid of Methods
Enterprise Agile - Hybrid of MethodsMaris Prabhakaran M
 
Continuous Delivery: why ? where to start ? how to scale ?
Continuous Delivery: why ? where to start ? how to scale ?Continuous Delivery: why ? where to start ? how to scale ?
Continuous Delivery: why ? where to start ? how to scale ?Jean-Philippe Briend
 
Rhonda Software Quality Assurance Services
Rhonda Software Quality Assurance ServicesRhonda Software Quality Assurance Services
Rhonda Software Quality Assurance ServicesRhonda Software
 
Be agile. Scale up. Stay Lean with SAFe by Michael Stump
Be agile. Scale up. Stay Lean with SAFe by Michael StumpBe agile. Scale up. Stay Lean with SAFe by Michael Stump
Be agile. Scale up. Stay Lean with SAFe by Michael StumpAgile ME
 
#ATAGTR2019 Presentation "Top 10 quality engineering best practices to achiev...
#ATAGTR2019 Presentation "Top 10 quality engineering best practices to achiev...#ATAGTR2019 Presentation "Top 10 quality engineering best practices to achiev...
#ATAGTR2019 Presentation "Top 10 quality engineering best practices to achiev...Agile Testing Alliance
 

Similar to Powering Safe Launch @ Scale (Feature Flags, Targeting, Experimentation) (20)

The quality assurance checklist for progressive testing
The quality assurance checklist for progressive testingThe quality assurance checklist for progressive testing
The quality assurance checklist for progressive testing
 
The Quality Assurance Checklist for Progressive Testing
The Quality Assurance Checklist for Progressive TestingThe Quality Assurance Checklist for Progressive Testing
The Quality Assurance Checklist for Progressive Testing
 
Agile Software Development Methodologies
Agile Software Development MethodologiesAgile Software Development Methodologies
Agile Software Development Methodologies
 
Agile software development
Agile software developmentAgile software development
Agile software development
 
[India Merge World Tour] Coverity
[India Merge World Tour] Coverity[India Merge World Tour] Coverity
[India Merge World Tour] Coverity
 
Agile-plus-DevOps Testing for Packaged Applications
Agile-plus-DevOps Testing for Packaged ApplicationsAgile-plus-DevOps Testing for Packaged Applications
Agile-plus-DevOps Testing for Packaged Applications
 
A Comprehensive Step-by-Step Guide for Designing an Agile-Friendly Automation...
A Comprehensive Step-by-Step Guide for Designing an Agile-Friendly Automation...A Comprehensive Step-by-Step Guide for Designing an Agile-Friendly Automation...
A Comprehensive Step-by-Step Guide for Designing an Agile-Friendly Automation...
 
Enterprise QA and Application Testing Services
Enterprise QA and Application Testing ServicesEnterprise QA and Application Testing Services
Enterprise QA and Application Testing Services
 
Enterprise QA and Application Testing Services
Enterprise QA and Application Testing ServicesEnterprise QA and Application Testing Services
Enterprise QA and Application Testing Services
 
How to Optimize Your Software Development Process for Maximum Efficiency.pdf
How to Optimize Your Software Development Process for Maximum Efficiency.pdfHow to Optimize Your Software Development Process for Maximum Efficiency.pdf
How to Optimize Your Software Development Process for Maximum Efficiency.pdf
 
Application Lifecycle Management (ALM), by Marco Silva
Application Lifecycle Management (ALM), by Marco SilvaApplication Lifecycle Management (ALM), by Marco Silva
Application Lifecycle Management (ALM), by Marco Silva
 
Scrum Portugal Meeting 1 Lisbon - ALM
Scrum Portugal Meeting 1 Lisbon - ALMScrum Portugal Meeting 1 Lisbon - ALM
Scrum Portugal Meeting 1 Lisbon - ALM
 
Digital Disruption with DevOps - Reference Architecture Overview
Digital Disruption with DevOps - Reference Architecture OverviewDigital Disruption with DevOps - Reference Architecture Overview
Digital Disruption with DevOps - Reference Architecture Overview
 
DevOps in Salesforce AppCloud
DevOps in Salesforce AppCloudDevOps in Salesforce AppCloud
DevOps in Salesforce AppCloud
 
Isec
IsecIsec
Isec
 
Enterprise Agile - Hybrid of Methods
Enterprise Agile - Hybrid of MethodsEnterprise Agile - Hybrid of Methods
Enterprise Agile - Hybrid of Methods
 
Continuous Delivery: why ? where to start ? how to scale ?
Continuous Delivery: why ? where to start ? how to scale ?Continuous Delivery: why ? where to start ? how to scale ?
Continuous Delivery: why ? where to start ? how to scale ?
 
Rhonda Software Quality Assurance Services
Rhonda Software Quality Assurance ServicesRhonda Software Quality Assurance Services
Rhonda Software Quality Assurance Services
 
Be agile. Scale up. Stay Lean with SAFe by Michael Stump
Be agile. Scale up. Stay Lean with SAFe by Michael StumpBe agile. Scale up. Stay Lean with SAFe by Michael Stump
Be agile. Scale up. Stay Lean with SAFe by Michael Stump
 
#ATAGTR2019 Presentation "Top 10 quality engineering best practices to achiev...
#ATAGTR2019 Presentation "Top 10 quality engineering best practices to achiev...#ATAGTR2019 Presentation "Top 10 quality engineering best practices to achiev...
#ATAGTR2019 Presentation "Top 10 quality engineering best practices to achiev...
 

Recently uploaded

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Victor Rentea
 
AI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAnitaRaj43
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...Zilliz
 
WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...
WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...
WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...WSO2
 
Quantum Leap in Next-Generation Computing
Quantum Leap in Next-Generation ComputingQuantum Leap in Next-Generation Computing
Quantum Leap in Next-Generation ComputingWSO2
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDropbox
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Simplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptxSimplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptxMarkSteadman7
 
API Governance and Monetization - The evolution of API governance
API Governance and Monetization -  The evolution of API governanceAPI Governance and Monetization -  The evolution of API governance
API Governance and Monetization - The evolution of API governanceWSO2
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Jeffrey Haguewood
 
JohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptxJohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptxJohnPollard37
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Victor Rentea
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxRemote DBA Services
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontologyjohnbeverley2021
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamUiPathCommunity
 
Less Is More: Utilizing Ballerina to Architect a Cloud Data Platform
Less Is More: Utilizing Ballerina to Architect a Cloud Data PlatformLess Is More: Utilizing Ballerina to Architect a Cloud Data Platform
Less Is More: Utilizing Ballerina to Architect a Cloud Data PlatformWSO2
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Orbitshub
 

Recently uploaded (20)

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
AI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by AnitarajAI in Action: Real World Use Cases by Anitaraj
AI in Action: Real World Use Cases by Anitaraj
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...
WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...
WSO2 Micro Integrator for Enterprise Integration in a Decentralized, Microser...
 
Quantum Leap in Next-Generation Computing
Quantum Leap in Next-Generation ComputingQuantum Leap in Next-Generation Computing
Quantum Leap in Next-Generation Computing
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Simplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptxSimplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptx
 
API Governance and Monetization - The evolution of API governance
API Governance and Monetization -  The evolution of API governanceAPI Governance and Monetization -  The evolution of API governance
API Governance and Monetization - The evolution of API governance
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
JohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptxJohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptx
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Less Is More: Utilizing Ballerina to Architect a Cloud Data Platform
Less Is More: Utilizing Ballerina to Architect a Cloud Data PlatformLess Is More: Utilizing Ballerina to Architect a Cloud Data Platform
Less Is More: Utilizing Ballerina to Architect a Cloud Data Platform
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 

Powering Safe Launch @ Scale (Feature Flags, Targeting, Experimentation)

  • 1. Powering Safe Launch @ Scale July 26th, 2017 Adil Aijaz CEO/Co-Founder @ Split adil@split.io
  • 2. ADIL AIJAZ Moving fast, and slow, at different scales since 2006
  • 3. Mission To empower enterprises to build better software, faster. Product An intelligent software delivery platform for developers, product managers and entire teams that enables safe launch, full-stack experimentation, and the dynamic configuration of features. About Us ● Founded in Redwood City, CA in 2015 by domain experts from Google, LinkedIn, Salesforce, and Databricks ● Backed by Accel Partners and Lightspeed Ventures
  • 4. Controlled Rollout & Experimentation Software is being delivered faster than ever before
  • 5. 90% of world’s data was created in the last 2 years
  • 6.
  • 7. Best software companies are agile and have a culture of experimentation
  • 9. Biggest force enabling agility: Continuous Delivery
  • 10. Software continuously delivered as small, iterative features
  • 11. ● Merging code into trunk on a daily basis. ● Having branches or forks with very short lifetimes - less than a day. ● Having fewer than three active branches at any time. Source: State of DevOps Report - 2016 Behaviors of “High Performance Teams”:
  • 12. Any feature deployment could break the product for all customers Continuous Risk:
  • 13. Microsoft used an army of QA engineers to solve this problem Back in the 90s:
  • 14. Modern teams use Safe Launch Today:
  • 15. Software continuously delivered as small, iterative features to subsets of customers …. then gradually dialed out to all customers
  • 16. Rooted in feature flags, A/B testing, and Dynamic Configuration
  • 18. Mechanism to separate code deploy from feature deploy.
  • 19. if (feature on) { // show feature } else { // do not show feature }
  • 20. Feature Flags + Targeting Engine
  • 21. if (feature on for this customer) { // show feature } else { // do not show feature }
  • 22. • Whitelisted Customers • Scrum Team • Employees • Pilot Partners • Customer Segments • Trial Customers • Geo Located Customers • Revenue Based Targeting • Percentages • 20% of all customers • 10% of Customers in Austin Launch Features to a Targeted Set of Customers
  • 24. • Agility • Trunk-Based Development • Customer Feedback Loop • Quality • Limits blast radius of problems. • Quality testing in production. • Performance • Stress test your systems before GA • Reduce cost of maintaining perf labs. • Security • Avoid copying production data to non-production environments Benefits
  • 25. You can’t be agile nor practice Continuous Delivery without Safe Launch Summary:
  • 27. One of the goals of agile development is to practice customer-centric development
  • 28. Start with an idea, launch prototype to customers, measure KPIs, then refine based on feedback loop
  • 29. Software delivered as small, iterative features to subsets of customers …. then measured for impact on KPIs
  • 31. Safe Launch is about stability + agility Experimentation is about optimization + stability + agility
  • 32. Launch A Recommendation Algorithm Safe Launch: Did we negatively impact any technical KPIs? Experimentation: Did we positively impact business KPI while avoiding negative impact on all technical and business KPIs?
  • 33. Safe Launch & Experimentation are two sides of the same coin
  • 34. Safe Launch / Stability / Agility Experimentation / Optimization Safe Launch / Stability / Agility Interplay of Safe Launch & Experimentation - 10% - 50% - 100%
  • 35. Experimentation is the frontier of modern software development
  • 36. Innovative Companies Build Safe Launch & Experimentation Platforms Gatekeeper LiX WebLabsUber XP
  • 37. For additional meetup information, please contact us on meetup@split.io Thank you!