Managing Environment Complexity in a Multi-
Cloud World
Shashi Kiran
kiran@quali.com
Environment Complexity and its Repercussions
Why Now? Can DevOps help?
Sandboxes –Standardize. Simplify. Scale
Agenda
Environment! = Laptop + IDE
“I can’t test or
QA anything until
I have access to
everything!”
Data Center
Systems
Cloud
Services
Partner
Services
Application
Enterprise
Storage
Middleware
Services
Distributed
Servers
• Infrastructure
• On-prem/Off prem
• Multiple OSs
• DBs
• Opensource
• Legacy
Complicated Environments that Mimic Production
Managing Dev/Test Environments for Complex Production is Hard
Quali 2016 Cloud and DevOps Survey
Engineer: 28%
Manager: 11%
C-Level: 10%
Director: 7%
Architect: 6%
DevOps: 3%
Sys Admin / OPS: 6%
VP: 3%
2045 Responses
Infographic
Download here: http://bit.ly/2nY4FTB
Environment Complexity: Dependencies
Pace of Digital Transformation (Speed)
Software Development across Tiered Organizations (Standardization)
Hybrid and Multi-Cloud Deployments (Scale)
Business Transformation Drives Pace of Change
42%
CEOs have begun
Digital Transformation
Source: Gartner, 451 Research
31%
IT priorities for CEO–
Highest ever
41%
Moderate to significant IT
transformation to achieve
growth
Every Industry is Powered by Software…
Source: PWC whitepaper
Estimate of
Revenue Growth
Compared to Key
Competitors
2010 2015 2020
CLOUD TRANSFORMATION
WORKLOADS AND KEY PROJECTS 2017
•Source: 451 Research, Voice of the Enterprise: Cloud
Transformation, Workloads and Key Projects 2017
•Q21. Which of the following
statements best describes how
your organization will use
different on-premises and off-
premises cloud environments
over the next 2 years?
•
11
38.4%
28.6%
20.4%
12.6%
We will focus primarily on a single cloud environment, not
multiple clouds.
We will have multiple different cloud environments, but
there will be little to no interoperability between the
cloud environments.
We will have multiple cloud environments to migrate
workloads or data between different cloud environments.
We will have multiple cloud environments where the
delivery of a single business function across the different
cloud environments is seamless.
Percent of Sample
n = 437
Use of Cloud Environments
Over Next Two Years
Cloud-Familiar Respondents Using Cloud
Computing
CLOUD TRANSFORMATION
WORKLOADS AND KEY PROJECTS 2017
•Source: 451 Research, Voice of the Enterprise: Cloud
Transformation, Workloads and Key Projects 2017
•Q23. Which of the following
best describes your hybrid or
multi-cloud strategy?
•
12
35.5%
31.0%
26.6%
24.6%
22.2%
12.5%
11.7%
4.4%
We dynamically move workloads to the most appropriate IT
environment based on cost, performance, security, data
sovereignty or other requirements.
We use on-premises resources mainly for existing workloads
but new workloads use IaaS/public clouds or hosted clouds.
Internal business systems and data run on-premises while
customer or end user-facing system run on IaaS/public or
hosted clouds.
We use IaaS/public or hosted clouds as an off-site location for
backup /disaster recovery/business continuity.
IaaS/public or hosted clouds are for our test/development
environment but on-premises or private clouds are for
production workloads.
We burst to public or hosted clouds when additional resource
is needed on-premises.
We are migrating workloads back on-premises that were
previously part of an IaaS/public or hosted environment.
Other
Percent of Sample
n = 248
Hybrid or Multi-Cloud
Strategy
Cloud Familiar Respondents Using Cloud
Computing
Getting the Balance Right on Speed…
Speed = f(performance, efficiency, skill)
our…vs. Risk
Risk = f(tolerance, quality, environment)
Security Company Breached
One of the “big-three” U.S. credit
bureaus.
May Impact 143M Americans.
Sep 7, 2017
Service Brownouts
Source: http://downdetector.com/status/netflix/map/
Public Cloud Outage
Example: Amazon S3, Feb 2017
- ~150K websites affected
- ~121K domains
- Quora, Expedia, Trello and several
others
- Impacted AWS status indicators
- “Outage caused by Human Error”
No cloud is Immune. Other public
and private clouds have similar issues
from time to time
“Lost In Translation” – The Price to Pay
30-40% of
Production
Outages Occur
within 24 Hours of
New Release
30-40% of defects
are attributed to
Environmental
Defects.
Hybrid/Multi-
Cloud
Environments
Amplify
complexity
Mis-matches in
production and
pre-production
environments
Impact System
Reliability
“Lost In Translation”
Speed Vs. Risk in the Software World
I pulled an all
nighter and just
deployed my code
“Whoa…what happened? It worked well on my desktop”
“I reproduced the problem. So, why isn’t it working? If only I could have access
to the working configuration <Sigh>”
“It was a small patch. My organization follows continuous I deployed directly
into production”
“It was working well in our datacenter. Why is the application performance
taking a hit on the public cloud?”
Did This Happen to You?
Application Complexity
Application Design
Application Testing
The Network
Infrastructure and Components of Application Services
The Butterfly Effect
Virtualization
Web Browser Scale / Peak Usage
Replicating Production Issues is Hard
Hybrid IT Multi-cloud
Compliance Security
Legacy Stack
Application Performance
Tune-up!!…
The Role of DevOps
SPEED
(PERFORMANCE)
QUALITY
(RISK)
DevOps
How can Sandboxes Help DevOps?
A sandbox is a testing environment that isolates
untested code changes and outright experimentation from the
production environment or repository,[1] in the context of software
development including Web developmentand revision control.
Static Vs. Dynamic Environments
STATIC
• Resources are pre-allocated
• Stateful
• WOMM
• Not repeatable
• Fixed configuration
DYNAMIC
• Resources allocated on demand and
reclaimed automatically
• Can select what’s saved between
sessions
• Repeatable
• Flexible configuration
• Require orchestration
• Can be provided on demand
• Users can Interact
Sandboxes and DevOps
SPEED
(PERFORMANCE)
QUALITY
(RISK)
Cloud
Sandbox
ENVIRONMENT
Move Fast, But Minimize Risk…and Oh, Don’t Break Things
Blueprint Modeling Automation & Orchestration
Reservation & Scheduling Self-Service Catalog
Built-In Networking BI & Analytics
REST API
EMBEDDED GUI
DevOps Plug-Ins
ON-DEMAND, SELF-SERVICE ENVIRONMENTS
Bare Metal
ON ANY CLOUD*
ENVIRONMENTFEATURESINTERACE
Applications Data Test Tools
Physical Infra. Virtual Infra. Services
Network Storage
Compute Security
CLOUD SANDBOX
Cloud Sandboxes: Manage Environment Complexity
Cloud Sandboxes - A Simple Mantra
Standardize Model Automate Reserve Test
S M A R T
Blueprint Dev/Test
Environments.
Publish to Self-
Service Catalogue
Infrastructure,
Applications,
Tools, Database
Automate and
Orchestrate Flow.
Visualization.
APIs
Spin-up or Spin
down
Environments on
any Cloud
Test. Measure.
Analyze
Standardize via Blueprints
ENVIRONMENT
• Blueprinting allows DevOps engineers to take
on the role of environment designers and
ensure standardization
• Reusable building blocks improve
maintainability and reduce overhead
• In-built connectivity
ENVIRONMENT
…Including Hybrid Environments
Database on
Premise Secure
Connectivity
Applications
and Public
Cloud IaaS
ENVIRONMENT
Publish to Self-Service Catalogs
ENVIRONMENT
Model Complex Environments
Spin Up/Spin-Down Resources
ENVIRONMENT
Automate and Orchestrate
Deploy VM to
Cloud
Configure
application
Provision network
connectivity
Load device
firmware
Configure Test
Tools
ENVIRONMENT
Orchestration workflow is a key first class citizen of the environment
Reserve – Deploy on Any Cloud
Bare Metal
ON ANY CLOUD*
“One-click” Deployment Path
• Test tools can be integrated
into the dynamic
environment and triggered
by the developer
Test – Including Continuous Testing
Typical CI/CD Pipeline
Manual Scripting. Fragmented Tools.
Dev Load Security Integration
Staging/
Production
CI/CD Pipeline – Sandboxes with RESTful API
Pipeline Automic
Quali
Sandbox
Software
Load Security Integration
Staging/
Production
Dev
Integrate With Existing DevOps Assets
Test framework
Build / Release Automation
Repository
Bug tracking Monitoring
Data Virtualization
Cloud & ContainersConfiguration
Management
Physical
Infrastructure
Sandboxes: Move Fast But De-Risk Production
Start coding
Servers
delivered
IT builds Dev/Test
environments
Request Dev/Test
resources from IT
Project starts
Gather requirements
Prioritize work
IT kicks off
procurement Deployment
Performance
testing
Testing
Bug fixing
Production
DEV/TEST: Needs access to configured
environments – ideally access to
“production-like environment” Local
machines won’t work. No wasting time
on configuration issues
DEVOPS TEAM: Monitor release
velocity and team productivity. Tools,
governance and metrics
Feedback to
Blueprints
Case Study
Large European
Retailer
• 200+ Developers Distributed Globally across 3 Countries
• Dynamic Environments Req. for: Dev, Feature Validation & CI
• Orchestration a first-class citizen
• Manual+ Automated testing. Compartmentalized Environments
• Include configuration and installation of test tools
• Deploy over Public Cloud (Microsoft Azure)
• Blueprinting and Orchestration Created Standardization
• Self-Service with Dynamic Environments
• Leverage existing tools and automation assets
• Self-Service - Better Collaboration – Improved Productivity
• Automation – Increased Speed
REQUIREMENTSVALUEBENEFIT
Case Study
Top 3 US Bank
• Hundreds of Dev/Test Engineers
• Datacenter with combination of legacy/modern applications
• Validate patching and version updates
• Regulatory Compliance
• Audit
• Measure Resource Consumption
• Integration with Physical and Virtual – Resource Pool
• Automation at Scale
• Faster software upgrades and patches while meeting
compliance requirements
• Better software quality
REQUIREMENTSVALUEBENEFIT
Parting Thoughts
Addressing Environment Complexity Can Simplify Hybrid and Multi-cloud
Rollouts
Standardize. Simplify. Scale with Cloud Sandboxes:
• Consistency between Production and Pre-Production Environments
• SMART – Integrate with DevOps CI/CD
• Balance Speed with Quality and Reduced Risk
DevOps
Tools
Cloud
Sandboxes?
Ask for a Technical Demo
(30-min web conference)
Start a Free Trial
(30-min web conference)
Ask for a Technical Demo
(30-min web conference)
VISIT US AT BOOTH #15
www.quali.com
Take Action
Thank You

Managing IT environment complexity in a Multi-Cloud World

  • 1.
    Managing Environment Complexityin a Multi- Cloud World Shashi Kiran kiran@quali.com
  • 2.
    Environment Complexity andits Repercussions Why Now? Can DevOps help? Sandboxes –Standardize. Simplify. Scale Agenda
  • 3.
  • 4.
    “I can’t testor QA anything until I have access to everything!” Data Center Systems Cloud Services Partner Services Application Enterprise Storage Middleware Services Distributed Servers • Infrastructure • On-prem/Off prem • Multiple OSs • DBs • Opensource • Legacy Complicated Environments that Mimic Production Managing Dev/Test Environments for Complex Production is Hard
  • 5.
    Quali 2016 Cloudand DevOps Survey Engineer: 28% Manager: 11% C-Level: 10% Director: 7% Architect: 6% DevOps: 3% Sys Admin / OPS: 6% VP: 3% 2045 Responses
  • 6.
  • 7.
    Environment Complexity: Dependencies Paceof Digital Transformation (Speed) Software Development across Tiered Organizations (Standardization) Hybrid and Multi-Cloud Deployments (Scale)
  • 8.
    Business Transformation DrivesPace of Change 42% CEOs have begun Digital Transformation Source: Gartner, 451 Research 31% IT priorities for CEO– Highest ever 41% Moderate to significant IT transformation to achieve growth
  • 9.
    Every Industry isPowered by Software…
  • 10.
    Source: PWC whitepaper Estimateof Revenue Growth Compared to Key Competitors 2010 2015 2020
  • 11.
    CLOUD TRANSFORMATION WORKLOADS ANDKEY PROJECTS 2017 •Source: 451 Research, Voice of the Enterprise: Cloud Transformation, Workloads and Key Projects 2017 •Q21. Which of the following statements best describes how your organization will use different on-premises and off- premises cloud environments over the next 2 years? • 11 38.4% 28.6% 20.4% 12.6% We will focus primarily on a single cloud environment, not multiple clouds. We will have multiple different cloud environments, but there will be little to no interoperability between the cloud environments. We will have multiple cloud environments to migrate workloads or data between different cloud environments. We will have multiple cloud environments where the delivery of a single business function across the different cloud environments is seamless. Percent of Sample n = 437 Use of Cloud Environments Over Next Two Years Cloud-Familiar Respondents Using Cloud Computing
  • 12.
    CLOUD TRANSFORMATION WORKLOADS ANDKEY PROJECTS 2017 •Source: 451 Research, Voice of the Enterprise: Cloud Transformation, Workloads and Key Projects 2017 •Q23. Which of the following best describes your hybrid or multi-cloud strategy? • 12 35.5% 31.0% 26.6% 24.6% 22.2% 12.5% 11.7% 4.4% We dynamically move workloads to the most appropriate IT environment based on cost, performance, security, data sovereignty or other requirements. We use on-premises resources mainly for existing workloads but new workloads use IaaS/public clouds or hosted clouds. Internal business systems and data run on-premises while customer or end user-facing system run on IaaS/public or hosted clouds. We use IaaS/public or hosted clouds as an off-site location for backup /disaster recovery/business continuity. IaaS/public or hosted clouds are for our test/development environment but on-premises or private clouds are for production workloads. We burst to public or hosted clouds when additional resource is needed on-premises. We are migrating workloads back on-premises that were previously part of an IaaS/public or hosted environment. Other Percent of Sample n = 248 Hybrid or Multi-Cloud Strategy Cloud Familiar Respondents Using Cloud Computing
  • 13.
    Getting the BalanceRight on Speed… Speed = f(performance, efficiency, skill)
  • 14.
    our…vs. Risk Risk =f(tolerance, quality, environment)
  • 15.
    Security Company Breached Oneof the “big-three” U.S. credit bureaus. May Impact 143M Americans. Sep 7, 2017
  • 16.
  • 17.
    Public Cloud Outage Example:Amazon S3, Feb 2017 - ~150K websites affected - ~121K domains - Quora, Expedia, Trello and several others - Impacted AWS status indicators - “Outage caused by Human Error” No cloud is Immune. Other public and private clouds have similar issues from time to time
  • 18.
    “Lost In Translation”– The Price to Pay 30-40% of Production Outages Occur within 24 Hours of New Release 30-40% of defects are attributed to Environmental Defects. Hybrid/Multi- Cloud Environments Amplify complexity Mis-matches in production and pre-production environments Impact System Reliability “Lost In Translation”
  • 19.
    Speed Vs. Riskin the Software World I pulled an all nighter and just deployed my code “Whoa…what happened? It worked well on my desktop” “I reproduced the problem. So, why isn’t it working? If only I could have access to the working configuration <Sigh>” “It was a small patch. My organization follows continuous I deployed directly into production” “It was working well in our datacenter. Why is the application performance taking a hit on the public cloud?” Did This Happen to You?
  • 20.
    Application Complexity Application Design ApplicationTesting The Network Infrastructure and Components of Application Services The Butterfly Effect Virtualization Web Browser Scale / Peak Usage Replicating Production Issues is Hard Hybrid IT Multi-cloud Compliance Security Legacy Stack Application Performance Tune-up!!…
  • 21.
    The Role ofDevOps SPEED (PERFORMANCE) QUALITY (RISK) DevOps
  • 22.
    How can SandboxesHelp DevOps? A sandbox is a testing environment that isolates untested code changes and outright experimentation from the production environment or repository,[1] in the context of software development including Web developmentand revision control.
  • 23.
    Static Vs. DynamicEnvironments STATIC • Resources are pre-allocated • Stateful • WOMM • Not repeatable • Fixed configuration DYNAMIC • Resources allocated on demand and reclaimed automatically • Can select what’s saved between sessions • Repeatable • Flexible configuration • Require orchestration • Can be provided on demand • Users can Interact
  • 24.
  • 25.
    Blueprint Modeling Automation& Orchestration Reservation & Scheduling Self-Service Catalog Built-In Networking BI & Analytics REST API EMBEDDED GUI DevOps Plug-Ins ON-DEMAND, SELF-SERVICE ENVIRONMENTS Bare Metal ON ANY CLOUD* ENVIRONMENTFEATURESINTERACE Applications Data Test Tools Physical Infra. Virtual Infra. Services Network Storage Compute Security CLOUD SANDBOX Cloud Sandboxes: Manage Environment Complexity
  • 26.
    Cloud Sandboxes -A Simple Mantra Standardize Model Automate Reserve Test S M A R T Blueprint Dev/Test Environments. Publish to Self- Service Catalogue Infrastructure, Applications, Tools, Database Automate and Orchestrate Flow. Visualization. APIs Spin-up or Spin down Environments on any Cloud Test. Measure. Analyze
  • 27.
    Standardize via Blueprints ENVIRONMENT •Blueprinting allows DevOps engineers to take on the role of environment designers and ensure standardization • Reusable building blocks improve maintainability and reduce overhead • In-built connectivity ENVIRONMENT
  • 28.
    …Including Hybrid Environments Databaseon Premise Secure Connectivity Applications and Public Cloud IaaS ENVIRONMENT
  • 29.
    Publish to Self-ServiceCatalogs ENVIRONMENT
  • 30.
    Model Complex Environments SpinUp/Spin-Down Resources ENVIRONMENT
  • 31.
    Automate and Orchestrate DeployVM to Cloud Configure application Provision network connectivity Load device firmware Configure Test Tools ENVIRONMENT Orchestration workflow is a key first class citizen of the environment
  • 32.
    Reserve – Deployon Any Cloud Bare Metal ON ANY CLOUD* “One-click” Deployment Path
  • 33.
    • Test toolscan be integrated into the dynamic environment and triggered by the developer Test – Including Continuous Testing
  • 34.
    Typical CI/CD Pipeline ManualScripting. Fragmented Tools. Dev Load Security Integration Staging/ Production
  • 35.
    CI/CD Pipeline –Sandboxes with RESTful API Pipeline Automic Quali Sandbox Software Load Security Integration Staging/ Production Dev
  • 36.
    Integrate With ExistingDevOps Assets Test framework Build / Release Automation Repository Bug tracking Monitoring Data Virtualization Cloud & ContainersConfiguration Management Physical Infrastructure
  • 37.
    Sandboxes: Move FastBut De-Risk Production Start coding Servers delivered IT builds Dev/Test environments Request Dev/Test resources from IT Project starts Gather requirements Prioritize work IT kicks off procurement Deployment Performance testing Testing Bug fixing Production DEV/TEST: Needs access to configured environments – ideally access to “production-like environment” Local machines won’t work. No wasting time on configuration issues DEVOPS TEAM: Monitor release velocity and team productivity. Tools, governance and metrics Feedback to Blueprints
  • 38.
    Case Study Large European Retailer •200+ Developers Distributed Globally across 3 Countries • Dynamic Environments Req. for: Dev, Feature Validation & CI • Orchestration a first-class citizen • Manual+ Automated testing. Compartmentalized Environments • Include configuration and installation of test tools • Deploy over Public Cloud (Microsoft Azure) • Blueprinting and Orchestration Created Standardization • Self-Service with Dynamic Environments • Leverage existing tools and automation assets • Self-Service - Better Collaboration – Improved Productivity • Automation – Increased Speed REQUIREMENTSVALUEBENEFIT
  • 39.
    Case Study Top 3US Bank • Hundreds of Dev/Test Engineers • Datacenter with combination of legacy/modern applications • Validate patching and version updates • Regulatory Compliance • Audit • Measure Resource Consumption • Integration with Physical and Virtual – Resource Pool • Automation at Scale • Faster software upgrades and patches while meeting compliance requirements • Better software quality REQUIREMENTSVALUEBENEFIT
  • 40.
    Parting Thoughts Addressing EnvironmentComplexity Can Simplify Hybrid and Multi-cloud Rollouts Standardize. Simplify. Scale with Cloud Sandboxes: • Consistency between Production and Pre-Production Environments • SMART – Integrate with DevOps CI/CD • Balance Speed with Quality and Reduced Risk
  • 41.
  • 42.
    Ask for aTechnical Demo (30-min web conference) Start a Free Trial (30-min web conference) Ask for a Technical Demo (30-min web conference) VISIT US AT BOOTH #15 www.quali.com Take Action
  • 43.

Editor's Notes

  • #30 Users select environments from a catalog DevOps team members design environments Managers set policies on consumption and permissions Consumption of an environment is always scoped by time or usage