SlideShare a Scribd company logo
1 of 19
Download to read offline
Nuz Mahmood & Daryl Dwyer
Measuring ROI to Drive Tanzu Application Services Adoption
September 3, 2020
2
Cloud Adoption Programs are Expensive and Complex
The journey:
A potentially complex one from legacy
infrastructure  n-tier infrastructure 
virtualization  public/ private/ hybrid
cloud …
The Cost:
Millions to billions of dollars…
Success:
Not guaranteed…
3
What are your goals? Most likely candidates:
 Scale applications beyond what the data center or hosting provider can handle
 Reduce operating costs
 Faster time to market
 A premium experience for the cloud tenant and/ or the end-user
 An improved experience for the developer and/or the administrator
These are worthwhile goals, and it’s worth spending resources and time to help your
investment in a platform like Tanzu Application Services be successful.
Invest in getting to your strategy’s desired result
4
Workstreams App Migration &
Modernization
Delivery Tools Platform
Enablement
Dev Enablement & Metrics
Mission Accelerate and
advance the adoption
of Tanzu Application
Services while re-
platforming and
modernizing our
application portfolio.
Support TAS adoption
by modernizing software
delivery pipeline to
leverage power of the
platform; create toolsets
to reduce delays in the
process including New
Application Services;
create and maintain
application inventory
system.
Provide and
operate a reliable
platform that
enables rapid
delivery of quality,
innovative
enterprise
applications.
Define and coach mindset,
behaviors, and skills for software
and testing artisanship; “how to”
modernize design of applications
so that they are right sized,
scalable, have resiliency,
leverage our investment in many
data centers, and require a lower
time to market for
delivering business value.
Drive adoption of Tanzu
Application Services using a
data-driven approach to realize
business case and program
goals.
Led By Application
Architecture
Cloud Platforms &
Strategy
Cloud Infrastructure
Engineering
Agile Transformation Office
Structuring the Tanzu Application Services program
Workstreams and Responsibilities
5
First, define what’s important to measure
 Spend some time to develop your strategy
 What behavior from software delivery teams fuels your metric?
 What program approach delivers on your objective
“Give me your monoliths, your client-server apps, your legacy
SOA services yearning to be free."
 “What is the one metric that matters?”
6
Next, operationalize your metrics collection
Set goals around enterprise adoption:
- Measure by team? by application?
- How many suitable teams or applications?
 Challenge #1: how do you define an application?
 Challenge #2: how do you collect the information?
 Note: Both of the above were subject to “organizational anti-bodies”,
i.e. resistance to change! “It’s too much overhead, it’s too broad a
definition, it’s not valuable, etc.”
Create Definitions
7
Then, Visualize Goal and Make Progress Transparent
• Visualizing the adoption using
a stacked bar chart
• “At a glance” totals for executive
tracking.
• Total is broken down by business
unit so managing directors can
compare their progress with others.
• Measured adoption to drive “lift and
shift” approach.
• Presented weekly to our CIO
and Managing Directors.
• Celebrated apps and teams
that were “in production” while
also giving recognition to those
that were “on platform”
1. Application subtotals grouped by delivery orgs like back office, middle office, retail, etc.
0
50
100
150
200
250
FY On Platform Goal On Platform In Production
NumberofApplications
Environment
YTD Adoption Compared to Goal
Business Unit 1 Business Unit 2 Business Unit 3 Business Unit 4
Business Unit 5 Business Unit 6 Business Unit 7
8
Translate Goal for Teams in Terms of ROI for Executives
Rapid adoption was the vision we wanted
our software delivery teams to embrace.
To drive engagement from executives,
translated “adoption of applications” to
hours saved.
“Return” was not in terms of revenue,
but time savings from adopting the
platform, which would increase
opportunity for productivity.
9
Collect Data to Measure Time Saved
1. Created a 65 question template of where Cloud Foundry
was likely to impact our software delivery and
operations processes.
1. Agreed on a dollar cost that would be used to translate
one hour of savings into a cost-offset:
a) If activity X used to take 3 hours before Cloud Foundry,
and now takes 1 hour;
b) And if each activity hour is paid at an average cost of
$75/hr;
c) Then the cost offset is (3*$75) – (1*$75) = $150 of cost-
offset.
With help from Tanzu’s insights
10
Data Collection
For the 65 question template, questions fell into these four categories:
1. Provisioning
• Time in the process of getting environments ready; Storage Setup; Build Server Setup; Firewall Configurations;
Load Balancer Configurations; Internal DNS setup; Databases; Configure access by Infra Ops; Setup for Splunk
monitoring
2. Planning
• Presentations, coordination, meetings to build consensus or gain alignment; pre-work meetings with Business
Process Lines; effort to request and implement Dev Sandbox function; Architecture Review Board; CI setup in
Jenkins
3. Development and Promotion
• Development Time; QA in Dev; Integration Testing in Dev; Deploy to integrated test environments; Deploy to
performance test environments, Deploy to Prod, deploy to disaster recovery environment, Server prep for Feature
Testing; Daily Team Meetings; issues in setup of non-prod environments.
4. Maintenance and Expansion
• Software Upgrades & Patching in Integration Testing environments; OS Patching, including scripts and server
prep; OS Upgrades including integration testing; Application Scaling including vertical scale CPU; Horizontal scale
instances; testing and server prep.
11
Data Collection - From whom, how many
• Used publicly available online calculator:
www.Raosoft.com/samplesize.html
• Established thresholds for these measures acceptable to
CIO and Managing Directors:
• Margin of error (Lower margin of error requires a larger
sample size.)
• Confidence Level (Higher confidence level requires a
larger sample size.)
• Estimated population size
• Response distribution
• Pursued data collection for recommended sample size
Determined sample size & desired confidence
12
Data Collection
• Completed on a rolling basis as teams adopted
Tanzu Application Services
• Interviewed two or more leads from the software
development team to gather data
• Operations questions pursued with those team
members.
• Kept the same interviewer for all data collection.
• Created Tableau dashboards to provide visibility into
progress made across the enterprise.
65 question questionnaire
How
13
Data Collection
Analyze and Visualize
14
Data Collection
Analyze and Visualize
“Measured apps” – numbers reflect number of interviews completed and data compiled
“Prod apps” – numbers of apps in the production environment. This is different from the adoption metrics.
The reason is that “ROI” isn’t fully realized until the app is in prod.
“Cost offset hours” calculated based on number of hours saved identified through the questionnaire.
Prod Apps
156
Measured Apps
39
Developer Efficiency
Improvement
Developer hours saved divided by
“before” developer hours X%
Cost offset hours for
prod apps
No. of apps in prod *
average cost offset
hours
Cost Offset hours for
measured apps
Sum of actual number of
cost offset hours for apps
in prod
Cost offset per measured app
Sum of cost offset hours divided
by number of measured apps.
15
Data Collection
Analyze and Visualize
16
Final Look and Insights Gained
• At the end of our program, we had
reached our adoption and ROI goals.
• …. And discovered in the process that
we needed to solve for delays in our
software delivery process.
• This gave rise to next “One Metric That
Matters,” i.e. Cycle Time.
• To pursue improvement in this metric,
we have started the next phase of our
journey, “Streamlining the Path to
Production.”
Application subtotals grouped by delivery orgs like back office, middle office, retail, etc.
0
100
200
300
400
500
600
700
800
On Platform In Production
NumberofApplications
Environment
Business Unit 1 Business Unit 2 Business Unit 3 Business Unit 4
Business Unit 5 Business Unit 6 Business Unit 7
17
18
Measuring ROI and Driving Adoption of TAS in an Enterprise

More Related Content

What's hot

What's hot (20)

Pivotal Platform - December Release A First Look
Pivotal Platform - December Release A First LookPivotal Platform - December Release A First Look
Pivotal Platform - December Release A First Look
 
“Sh*^%# on Fire, Yo!”: A True Story Inspired by Real Events
“Sh*^%# on Fire, Yo!”: A True Story Inspired by Real Events“Sh*^%# on Fire, Yo!”: A True Story Inspired by Real Events
“Sh*^%# on Fire, Yo!”: A True Story Inspired by Real Events
 
Ensuring Security and Feature Freshness with VMware Tanzu Observability
Ensuring Security and Feature Freshness with VMware Tanzu ObservabilityEnsuring Security and Feature Freshness with VMware Tanzu Observability
Ensuring Security and Feature Freshness with VMware Tanzu Observability
 
Spring Cloud Kubernetes: An Easier Path from Idea to Production
Spring Cloud Kubernetes: An Easier Path from Idea to ProductionSpring Cloud Kubernetes: An Easier Path from Idea to Production
Spring Cloud Kubernetes: An Easier Path from Idea to Production
 
Cloud-Native Fundamentals: An Introduction to 12-Factor Applications
Cloud-Native Fundamentals: An Introduction to 12-Factor ApplicationsCloud-Native Fundamentals: An Introduction to 12-Factor Applications
Cloud-Native Fundamentals: An Introduction to 12-Factor Applications
 
Spring Tools 4: Bootiful Spring Tooling for the Masses
Spring Tools 4: Bootiful Spring Tooling for the MassesSpring Tools 4: Bootiful Spring Tooling for the Masses
Spring Tools 4: Bootiful Spring Tooling for the Masses
 
VMware Tanzu Application Service as an Integration Platform
VMware Tanzu Application Service as an Integration PlatformVMware Tanzu Application Service as an Integration Platform
VMware Tanzu Application Service as an Integration Platform
 
Deploy Code into Production Faster on Kubernetes
Deploy Code into Production Faster on KubernetesDeploy Code into Production Faster on Kubernetes
Deploy Code into Production Faster on Kubernetes
 
Leveraging Standard Buildpacks to Migrate Not-So-Standard Apps
Leveraging Standard Buildpacks to Migrate Not-So-Standard AppsLeveraging Standard Buildpacks to Migrate Not-So-Standard Apps
Leveraging Standard Buildpacks to Migrate Not-So-Standard Apps
 
July 30: How User-Centered Design Drives Impactful Products and Services
July 30: How User-Centered Design Drives Impactful Products and ServicesJuly 30: How User-Centered Design Drives Impactful Products and Services
July 30: How User-Centered Design Drives Impactful Products and Services
 
From Pivotal to VMware Tanzu: What you need to know
From Pivotal to VMware Tanzu: What you need to knowFrom Pivotal to VMware Tanzu: What you need to know
From Pivotal to VMware Tanzu: What you need to know
 
Measuring DevOps Impact to Boost Effectiveness
Measuring DevOps Impact to Boost EffectivenessMeasuring DevOps Impact to Boost Effectiveness
Measuring DevOps Impact to Boost Effectiveness
 
Walking Through Spring Cloud Data Flow
Walking Through Spring Cloud Data FlowWalking Through Spring Cloud Data Flow
Walking Through Spring Cloud Data Flow
 
Troubleshooting App Health and Performance with PCF Metrics 1.2
Troubleshooting App Health and Performance with PCF Metrics 1.2Troubleshooting App Health and Performance with PCF Metrics 1.2
Troubleshooting App Health and Performance with PCF Metrics 1.2
 
What Is Spring?
What Is Spring?What Is Spring?
What Is Spring?
 
Integrate Machine Learning into Your Spring Application in Less than an Hour
Integrate Machine Learning into Your Spring Application in Less than an HourIntegrate Machine Learning into Your Spring Application in Less than an Hour
Integrate Machine Learning into Your Spring Application in Less than an Hour
 
July 29: Achieve Stakeholder Alignment on Governance: Navigator by Pivotal Labs
July 29: Achieve Stakeholder Alignment on Governance: Navigator by Pivotal LabsJuly 29: Achieve Stakeholder Alignment on Governance: Navigator by Pivotal Labs
July 29: Achieve Stakeholder Alignment on Governance: Navigator by Pivotal Labs
 
Architecture & Operations
Architecture & OperationsArchitecture & Operations
Architecture & Operations
 
Container delivery is a revolution not evolution
Container delivery is a revolution not evolutionContainer delivery is a revolution not evolution
Container delivery is a revolution not evolution
 
Introduction to Heroku
Introduction to HerokuIntroduction to Heroku
Introduction to Heroku
 

Similar to Measuring ROI and Driving Adoption of TAS in an Enterprise

JeffDavisProjectPortfolio
JeffDavisProjectPortfolioJeffDavisProjectPortfolio
JeffDavisProjectPortfolio
Jeff Davis
 

Similar to Measuring ROI and Driving Adoption of TAS in an Enterprise (20)

Are your cloud applications performing? How Application Performance Managemen...
Are your cloud applications performing? How Application Performance Managemen...Are your cloud applications performing? How Application Performance Managemen...
Are your cloud applications performing? How Application Performance Managemen...
 
Using Lean Thinking to identify and address Delivery Pipeline bottlenecks
Using Lean Thinking to identify and address Delivery Pipeline bottlenecksUsing Lean Thinking to identify and address Delivery Pipeline bottlenecks
Using Lean Thinking to identify and address Delivery Pipeline bottlenecks
 
What is DevOps?
What is DevOps?What is DevOps?
What is DevOps?
 
JeffDavisProjectPortfolio
JeffDavisProjectPortfolioJeffDavisProjectPortfolio
JeffDavisProjectPortfolio
 
Migrating to Cloud: Inhouse Hadoop to Databricks (3)
Migrating to Cloud: Inhouse Hadoop to Databricks (3)Migrating to Cloud: Inhouse Hadoop to Databricks (3)
Migrating to Cloud: Inhouse Hadoop to Databricks (3)
 
Cloud Adoption Plan - Planning phase
Cloud Adoption Plan - Planning phaseCloud Adoption Plan - Planning phase
Cloud Adoption Plan - Planning phase
 
Re-Platforming Applications for the Cloud
Re-Platforming Applications for the CloudRe-Platforming Applications for the Cloud
Re-Platforming Applications for the Cloud
 
nitesh_rajpurkar_2016
nitesh_rajpurkar_2016nitesh_rajpurkar_2016
nitesh_rajpurkar_2016
 
Pivotal korea transformation_strategy_seminar_enterprise_dev_ops_20160630_v1.0
Pivotal korea transformation_strategy_seminar_enterprise_dev_ops_20160630_v1.0Pivotal korea transformation_strategy_seminar_enterprise_dev_ops_20160630_v1.0
Pivotal korea transformation_strategy_seminar_enterprise_dev_ops_20160630_v1.0
 
Application Migration: How to Start, Scale and Succeed
Application Migration: How to Start, Scale and SucceedApplication Migration: How to Start, Scale and Succeed
Application Migration: How to Start, Scale and Succeed
 
A Blueprint for a Successful DevOps Metamorphosis
A Blueprint for a Successful DevOps MetamorphosisA Blueprint for a Successful DevOps Metamorphosis
A Blueprint for a Successful DevOps Metamorphosis
 
How to Start Your Application Modernization Journey
How to Start Your Application Modernization JourneyHow to Start Your Application Modernization Journey
How to Start Your Application Modernization Journey
 
The 3 Pillars of Remote Application Development
The 3 Pillars of Remote Application DevelopmentThe 3 Pillars of Remote Application Development
The 3 Pillars of Remote Application Development
 
Neev Competencies in SaaS-based Development
Neev Competencies in SaaS-based DevelopmentNeev Competencies in SaaS-based Development
Neev Competencies in SaaS-based Development
 
DevOps Implementation Roadmap
DevOps Implementation RoadmapDevOps Implementation Roadmap
DevOps Implementation Roadmap
 
A DevOps adoption playbook- achieving business value at scale
A DevOps adoption playbook- achieving business value at scaleA DevOps adoption playbook- achieving business value at scale
A DevOps adoption playbook- achieving business value at scale
 
Lect7
Lect7Lect7
Lect7
 
Lect7
Lect7Lect7
Lect7
 
Adopting DevOps for 2-Speed IT
Adopting DevOps for 2-Speed ITAdopting DevOps for 2-Speed IT
Adopting DevOps for 2-Speed IT
 
DevOps and Application Delivery for Hybrid Cloud - DevOpsSummit session
DevOps and Application Delivery for Hybrid Cloud  - DevOpsSummit sessionDevOps and Application Delivery for Hybrid Cloud  - DevOpsSummit session
DevOps and Application Delivery for Hybrid Cloud - DevOpsSummit session
 

More from VMware Tanzu

More from VMware Tanzu (20)

Spring into AI presented by Dan Vega 5/14
Spring into AI presented by Dan Vega 5/14Spring into AI presented by Dan Vega 5/14
Spring into AI presented by Dan Vega 5/14
 
What AI Means For Your Product Strategy And What To Do About It
What AI Means For Your Product Strategy And What To Do About ItWhat AI Means For Your Product Strategy And What To Do About It
What AI Means For Your Product Strategy And What To Do About It
 
Make the Right Thing the Obvious Thing at Cardinal Health 2023
Make the Right Thing the Obvious Thing at Cardinal Health 2023Make the Right Thing the Obvious Thing at Cardinal Health 2023
Make the Right Thing the Obvious Thing at Cardinal Health 2023
 
Enhancing DevEx and Simplifying Operations at Scale
Enhancing DevEx and Simplifying Operations at ScaleEnhancing DevEx and Simplifying Operations at Scale
Enhancing DevEx and Simplifying Operations at Scale
 
Spring Update | July 2023
Spring Update | July 2023Spring Update | July 2023
Spring Update | July 2023
 
Platforms, Platform Engineering, & Platform as a Product
Platforms, Platform Engineering, & Platform as a ProductPlatforms, Platform Engineering, & Platform as a Product
Platforms, Platform Engineering, & Platform as a Product
 
Building Cloud Ready Apps
Building Cloud Ready AppsBuilding Cloud Ready Apps
Building Cloud Ready Apps
 
Spring Boot 3 And Beyond
Spring Boot 3 And BeyondSpring Boot 3 And Beyond
Spring Boot 3 And Beyond
 
Spring Cloud Gateway - SpringOne Tour 2023 Charles Schwab.pdf
Spring Cloud Gateway - SpringOne Tour 2023 Charles Schwab.pdfSpring Cloud Gateway - SpringOne Tour 2023 Charles Schwab.pdf
Spring Cloud Gateway - SpringOne Tour 2023 Charles Schwab.pdf
 
Simplify and Scale Enterprise Apps in the Cloud | Boston 2023
Simplify and Scale Enterprise Apps in the Cloud | Boston 2023Simplify and Scale Enterprise Apps in the Cloud | Boston 2023
Simplify and Scale Enterprise Apps in the Cloud | Boston 2023
 
Simplify and Scale Enterprise Apps in the Cloud | Seattle 2023
Simplify and Scale Enterprise Apps in the Cloud | Seattle 2023Simplify and Scale Enterprise Apps in the Cloud | Seattle 2023
Simplify and Scale Enterprise Apps in the Cloud | Seattle 2023
 
tanzu_developer_connect.pptx
tanzu_developer_connect.pptxtanzu_developer_connect.pptx
tanzu_developer_connect.pptx
 
Tanzu Virtual Developer Connect Workshop - French
Tanzu Virtual Developer Connect Workshop - FrenchTanzu Virtual Developer Connect Workshop - French
Tanzu Virtual Developer Connect Workshop - French
 
Tanzu Developer Connect Workshop - English
Tanzu Developer Connect Workshop - EnglishTanzu Developer Connect Workshop - English
Tanzu Developer Connect Workshop - English
 
Virtual Developer Connect Workshop - English
Virtual Developer Connect Workshop - EnglishVirtual Developer Connect Workshop - English
Virtual Developer Connect Workshop - English
 
Tanzu Developer Connect - French
Tanzu Developer Connect - FrenchTanzu Developer Connect - French
Tanzu Developer Connect - French
 
Simplify and Scale Enterprise Apps in the Cloud | Dallas 2023
Simplify and Scale Enterprise Apps in the Cloud | Dallas 2023Simplify and Scale Enterprise Apps in the Cloud | Dallas 2023
Simplify and Scale Enterprise Apps in the Cloud | Dallas 2023
 
SpringOne Tour: Deliver 15-Factor Applications on Kubernetes with Spring Boot
SpringOne Tour: Deliver 15-Factor Applications on Kubernetes with Spring BootSpringOne Tour: Deliver 15-Factor Applications on Kubernetes with Spring Boot
SpringOne Tour: Deliver 15-Factor Applications on Kubernetes with Spring Boot
 
SpringOne Tour: The Influential Software Engineer
SpringOne Tour: The Influential Software EngineerSpringOne Tour: The Influential Software Engineer
SpringOne Tour: The Influential Software Engineer
 
SpringOne Tour: Domain-Driven Design: Theory vs Practice
SpringOne Tour: Domain-Driven Design: Theory vs PracticeSpringOne Tour: Domain-Driven Design: Theory vs Practice
SpringOne Tour: Domain-Driven Design: Theory vs Practice
 

Recently uploaded

Abortion Pills For Sale WhatsApp[[+27737758557]] In Birch Acres, Abortion Pil...
Abortion Pills For Sale WhatsApp[[+27737758557]] In Birch Acres, Abortion Pil...Abortion Pills For Sale WhatsApp[[+27737758557]] In Birch Acres, Abortion Pil...
Abortion Pills For Sale WhatsApp[[+27737758557]] In Birch Acres, Abortion Pil...
drm1699
 

Recently uploaded (20)

Community is Just as Important as Code by Andrea Goulet
Community is Just as Important as Code by Andrea GouletCommunity is Just as Important as Code by Andrea Goulet
Community is Just as Important as Code by Andrea Goulet
 
Transformer Neural Network Use Cases with Links
Transformer Neural Network Use Cases with LinksTransformer Neural Network Use Cases with Links
Transformer Neural Network Use Cases with Links
 
architecting-ai-in-the-enterprise-apis-and-applications.pdf
architecting-ai-in-the-enterprise-apis-and-applications.pdfarchitecting-ai-in-the-enterprise-apis-and-applications.pdf
architecting-ai-in-the-enterprise-apis-and-applications.pdf
 
What is a Recruitment Management Software?
What is a Recruitment Management Software?What is a Recruitment Management Software?
What is a Recruitment Management Software?
 
Entropy, Software Quality, and Innovation (presented at Princeton Plasma Phys...
Entropy, Software Quality, and Innovation (presented at Princeton Plasma Phys...Entropy, Software Quality, and Innovation (presented at Princeton Plasma Phys...
Entropy, Software Quality, and Innovation (presented at Princeton Plasma Phys...
 
Workshop: Enabling GenAI Breakthroughs with Knowledge Graphs - GraphSummit Milan
Workshop: Enabling GenAI Breakthroughs with Knowledge Graphs - GraphSummit MilanWorkshop: Enabling GenAI Breakthroughs with Knowledge Graphs - GraphSummit Milan
Workshop: Enabling GenAI Breakthroughs with Knowledge Graphs - GraphSummit Milan
 
Abortion Pill Prices Jane Furse ](+27832195400*)[ 🏥 Women's Abortion Clinic i...
Abortion Pill Prices Jane Furse ](+27832195400*)[ 🏥 Women's Abortion Clinic i...Abortion Pill Prices Jane Furse ](+27832195400*)[ 🏥 Women's Abortion Clinic i...
Abortion Pill Prices Jane Furse ](+27832195400*)[ 🏥 Women's Abortion Clinic i...
 
OpenChain Webinar: AboutCode and Beyond - End-to-End SCA
OpenChain Webinar: AboutCode and Beyond - End-to-End SCAOpenChain Webinar: AboutCode and Beyond - End-to-End SCA
OpenChain Webinar: AboutCode and Beyond - End-to-End SCA
 
Abortion Clinic Pretoria ](+27832195400*)[ Abortion Clinic Near Me ● Abortion...
Abortion Clinic Pretoria ](+27832195400*)[ Abortion Clinic Near Me ● Abortion...Abortion Clinic Pretoria ](+27832195400*)[ Abortion Clinic Near Me ● Abortion...
Abortion Clinic Pretoria ](+27832195400*)[ Abortion Clinic Near Me ● Abortion...
 
Abortion Clinic In Johannesburg ](+27832195400*)[ 🏥 Safe Abortion Pills in Jo...
Abortion Clinic In Johannesburg ](+27832195400*)[ 🏥 Safe Abortion Pills in Jo...Abortion Clinic In Johannesburg ](+27832195400*)[ 🏥 Safe Abortion Pills in Jo...
Abortion Clinic In Johannesburg ](+27832195400*)[ 🏥 Safe Abortion Pills in Jo...
 
Microsoft365_Dev_Security_2024_05_16.pdf
Microsoft365_Dev_Security_2024_05_16.pdfMicrosoft365_Dev_Security_2024_05_16.pdf
Microsoft365_Dev_Security_2024_05_16.pdf
 
COMPUTER AND ITS COMPONENTS PPT.by naitik sharma Class 9th A mittal internati...
COMPUTER AND ITS COMPONENTS PPT.by naitik sharma Class 9th A mittal internati...COMPUTER AND ITS COMPONENTS PPT.by naitik sharma Class 9th A mittal internati...
COMPUTER AND ITS COMPONENTS PPT.by naitik sharma Class 9th A mittal internati...
 
Modern binary build systems - PyCon 2024
Modern binary build systems - PyCon 2024Modern binary build systems - PyCon 2024
Modern binary build systems - PyCon 2024
 
The mythical technical debt. (Brooke, please, forgive me)
The mythical technical debt. (Brooke, please, forgive me)The mythical technical debt. (Brooke, please, forgive me)
The mythical technical debt. (Brooke, please, forgive me)
 
Food Delivery Business App Development Guide 2024
Food Delivery Business App Development Guide 2024Food Delivery Business App Development Guide 2024
Food Delivery Business App Development Guide 2024
 
The Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdf
The Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdfThe Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdf
The Evolution of Web App Testing_ An Ultimate Guide to Future Trends.pdf
 
Abortion Pills For Sale WhatsApp[[+27737758557]] In Birch Acres, Abortion Pil...
Abortion Pills For Sale WhatsApp[[+27737758557]] In Birch Acres, Abortion Pil...Abortion Pills For Sale WhatsApp[[+27737758557]] In Birch Acres, Abortion Pil...
Abortion Pills For Sale WhatsApp[[+27737758557]] In Birch Acres, Abortion Pil...
 
Abortion Clinic In Pretoria ](+27832195400*)[ 🏥 Safe Abortion Pills in Pretor...
Abortion Clinic In Pretoria ](+27832195400*)[ 🏥 Safe Abortion Pills in Pretor...Abortion Clinic In Pretoria ](+27832195400*)[ 🏥 Safe Abortion Pills in Pretor...
Abortion Clinic In Pretoria ](+27832195400*)[ 🏥 Safe Abortion Pills in Pretor...
 
From Theory to Practice: Utilizing SpiraPlan's REST API
From Theory to Practice: Utilizing SpiraPlan's REST APIFrom Theory to Practice: Utilizing SpiraPlan's REST API
From Theory to Practice: Utilizing SpiraPlan's REST API
 
Navigation in flutter – how to add stack, tab, and drawer navigators to your ...
Navigation in flutter – how to add stack, tab, and drawer navigators to your ...Navigation in flutter – how to add stack, tab, and drawer navigators to your ...
Navigation in flutter – how to add stack, tab, and drawer navigators to your ...
 

Measuring ROI and Driving Adoption of TAS in an Enterprise

  • 1. Nuz Mahmood & Daryl Dwyer Measuring ROI to Drive Tanzu Application Services Adoption September 3, 2020
  • 2. 2 Cloud Adoption Programs are Expensive and Complex The journey: A potentially complex one from legacy infrastructure  n-tier infrastructure  virtualization  public/ private/ hybrid cloud … The Cost: Millions to billions of dollars… Success: Not guaranteed…
  • 3. 3 What are your goals? Most likely candidates:  Scale applications beyond what the data center or hosting provider can handle  Reduce operating costs  Faster time to market  A premium experience for the cloud tenant and/ or the end-user  An improved experience for the developer and/or the administrator These are worthwhile goals, and it’s worth spending resources and time to help your investment in a platform like Tanzu Application Services be successful. Invest in getting to your strategy’s desired result
  • 4. 4 Workstreams App Migration & Modernization Delivery Tools Platform Enablement Dev Enablement & Metrics Mission Accelerate and advance the adoption of Tanzu Application Services while re- platforming and modernizing our application portfolio. Support TAS adoption by modernizing software delivery pipeline to leverage power of the platform; create toolsets to reduce delays in the process including New Application Services; create and maintain application inventory system. Provide and operate a reliable platform that enables rapid delivery of quality, innovative enterprise applications. Define and coach mindset, behaviors, and skills for software and testing artisanship; “how to” modernize design of applications so that they are right sized, scalable, have resiliency, leverage our investment in many data centers, and require a lower time to market for delivering business value. Drive adoption of Tanzu Application Services using a data-driven approach to realize business case and program goals. Led By Application Architecture Cloud Platforms & Strategy Cloud Infrastructure Engineering Agile Transformation Office Structuring the Tanzu Application Services program Workstreams and Responsibilities
  • 5. 5 First, define what’s important to measure  Spend some time to develop your strategy  What behavior from software delivery teams fuels your metric?  What program approach delivers on your objective “Give me your monoliths, your client-server apps, your legacy SOA services yearning to be free."  “What is the one metric that matters?”
  • 6. 6 Next, operationalize your metrics collection Set goals around enterprise adoption: - Measure by team? by application? - How many suitable teams or applications?  Challenge #1: how do you define an application?  Challenge #2: how do you collect the information?  Note: Both of the above were subject to “organizational anti-bodies”, i.e. resistance to change! “It’s too much overhead, it’s too broad a definition, it’s not valuable, etc.” Create Definitions
  • 7. 7 Then, Visualize Goal and Make Progress Transparent • Visualizing the adoption using a stacked bar chart • “At a glance” totals for executive tracking. • Total is broken down by business unit so managing directors can compare their progress with others. • Measured adoption to drive “lift and shift” approach. • Presented weekly to our CIO and Managing Directors. • Celebrated apps and teams that were “in production” while also giving recognition to those that were “on platform” 1. Application subtotals grouped by delivery orgs like back office, middle office, retail, etc. 0 50 100 150 200 250 FY On Platform Goal On Platform In Production NumberofApplications Environment YTD Adoption Compared to Goal Business Unit 1 Business Unit 2 Business Unit 3 Business Unit 4 Business Unit 5 Business Unit 6 Business Unit 7
  • 8. 8 Translate Goal for Teams in Terms of ROI for Executives Rapid adoption was the vision we wanted our software delivery teams to embrace. To drive engagement from executives, translated “adoption of applications” to hours saved. “Return” was not in terms of revenue, but time savings from adopting the platform, which would increase opportunity for productivity.
  • 9. 9 Collect Data to Measure Time Saved 1. Created a 65 question template of where Cloud Foundry was likely to impact our software delivery and operations processes. 1. Agreed on a dollar cost that would be used to translate one hour of savings into a cost-offset: a) If activity X used to take 3 hours before Cloud Foundry, and now takes 1 hour; b) And if each activity hour is paid at an average cost of $75/hr; c) Then the cost offset is (3*$75) – (1*$75) = $150 of cost- offset. With help from Tanzu’s insights
  • 10. 10 Data Collection For the 65 question template, questions fell into these four categories: 1. Provisioning • Time in the process of getting environments ready; Storage Setup; Build Server Setup; Firewall Configurations; Load Balancer Configurations; Internal DNS setup; Databases; Configure access by Infra Ops; Setup for Splunk monitoring 2. Planning • Presentations, coordination, meetings to build consensus or gain alignment; pre-work meetings with Business Process Lines; effort to request and implement Dev Sandbox function; Architecture Review Board; CI setup in Jenkins 3. Development and Promotion • Development Time; QA in Dev; Integration Testing in Dev; Deploy to integrated test environments; Deploy to performance test environments, Deploy to Prod, deploy to disaster recovery environment, Server prep for Feature Testing; Daily Team Meetings; issues in setup of non-prod environments. 4. Maintenance and Expansion • Software Upgrades & Patching in Integration Testing environments; OS Patching, including scripts and server prep; OS Upgrades including integration testing; Application Scaling including vertical scale CPU; Horizontal scale instances; testing and server prep.
  • 11. 11 Data Collection - From whom, how many • Used publicly available online calculator: www.Raosoft.com/samplesize.html • Established thresholds for these measures acceptable to CIO and Managing Directors: • Margin of error (Lower margin of error requires a larger sample size.) • Confidence Level (Higher confidence level requires a larger sample size.) • Estimated population size • Response distribution • Pursued data collection for recommended sample size Determined sample size & desired confidence
  • 12. 12 Data Collection • Completed on a rolling basis as teams adopted Tanzu Application Services • Interviewed two or more leads from the software development team to gather data • Operations questions pursued with those team members. • Kept the same interviewer for all data collection. • Created Tableau dashboards to provide visibility into progress made across the enterprise. 65 question questionnaire How
  • 14. 14 Data Collection Analyze and Visualize “Measured apps” – numbers reflect number of interviews completed and data compiled “Prod apps” – numbers of apps in the production environment. This is different from the adoption metrics. The reason is that “ROI” isn’t fully realized until the app is in prod. “Cost offset hours” calculated based on number of hours saved identified through the questionnaire. Prod Apps 156 Measured Apps 39 Developer Efficiency Improvement Developer hours saved divided by “before” developer hours X% Cost offset hours for prod apps No. of apps in prod * average cost offset hours Cost Offset hours for measured apps Sum of actual number of cost offset hours for apps in prod Cost offset per measured app Sum of cost offset hours divided by number of measured apps.
  • 16. 16 Final Look and Insights Gained • At the end of our program, we had reached our adoption and ROI goals. • …. And discovered in the process that we needed to solve for delays in our software delivery process. • This gave rise to next “One Metric That Matters,” i.e. Cycle Time. • To pursue improvement in this metric, we have started the next phase of our journey, “Streamlining the Path to Production.” Application subtotals grouped by delivery orgs like back office, middle office, retail, etc. 0 100 200 300 400 500 600 700 800 On Platform In Production NumberofApplications Environment Business Unit 1 Business Unit 2 Business Unit 3 Business Unit 4 Business Unit 5 Business Unit 6 Business Unit 7
  • 17. 17
  • 18. 18