CF
Uploaded byChristopher Foot
PPTX, PDF1,994 views

Cloud's Hidden Impact on IT Shops

The document outlines the complexities and considerations involved in cloud database management, including service options like IaaS and DBaaS. It emphasizes the need for thorough evaluation of vendors, pricing models, and changes in support infrastructure roles when migrating to cloud systems. Additionally, it highlights the organizational impact and necessary adjustments in compliance, security, and change management processes.

Embed presentation

Downloaded 12 times
www.rdx.com 1 © 2018 STRATEGIES COMPLIANCE SECURITY PERFORMANCE CHANGE MANAGEMENT COSTING EDUCATION ADMINISTRATION MONITORING DATA TRANSFERS ORGANIZATIONAL ROLES THIRD-PARTY/IN-HOUSE APPS IN-HOUSE TOOLS STANDARD OPERATING PROCEDURES SUPPORT DOCUMENTATION Cloud DB Systems’ Hidden Impact on IT They Will Be Greater Than You Think
www.rdx.com 2 © 2018© 2018 20 YEARS OF SERVICE DELIVERY EXPERIENCE Database Platforms SQL Server Oracle PostgreSQL* DB2 MongoDB* MySQL* Operating Systems Unix/Linux*Windows Enterprise Applications SQL Server BI Oracle EBS SharePoint Exchange Environment 800+ Customers 20,000 DBs 200+ DBAs Fortune 100s Startups All Verticals Cloud Systems Amazon AWS/RDS Oracle Cloud DB DBaaS Msoft Azure IaaS Multi-Cloud * All distributions The Largest Pure Play Provider of Managed Data Infrastructure Services
www.rdx.com 3 © 2018© 2018 Database Administration Cloud Migration & Administration Operating System Support Business Intelligence & Reporting Business Applications Support Monitoring & Problem Resolution Full SupportSupplemental Support Core Services
www.rdx.com 4 © 2018© 2018 Including Cloud DBaaS and IaaS Environments Database & OS Maintenance Backup & Recovery Installs, Upgrades & Patching Change Management Monitoring, Alerting & Event Management Performance Tuning Assessments & Health Checks Troubleshooting Database Security & Auditing High Availability System Design & Deployment Cloud Migrations and Support Advanced Architectures Strategic Planning
www.rdx.com 5 © 2018© 2018 Cloud DBs are Architectures - Not Products Offerings Range from Simple to Rocket Science Cloud DBs Impact on Support > What Most Think Not all DB Apps are “Cloud Friendly” Here’s What We’ve Learned Working With Cloud DBs
www.rdx.com 6 © 2018© 2018 There are Many Different Cloud DBMS Offerings and Pricing Models IAAS
www.rdx.com 7 © 2018 Auditing and Compliance OSConfiguration Disk Configuration CPU Pricing Models Monitoring Memory Administration Access Mechanisms ArchitectureDesign Policies&Procedures Tools Training Security EdgeTechnologies Backup/Recovery StaffRoles Redundancy Provisioning Tuning Cloud DB Systems are Architectures, Not Products
www.rdx.com 8 © 2018© 2018 You Will Need to Thoroughly Evaluate The Impact Those Changes Will Make Fully Investigate Cloud Platform • Pricing Models • Read Fine Print! • Vendor Lock In • DB Features • Elasticity • Scalability • Site Locations • Track Record • Storage • Compute • Provisioning • Monitoring Tools • Admin Tools • Backup • Security • Data Access RDS EC2 Apps Optimization Scaling HA DB Backups DB Patches DB Installs OS Patches OS Installs Server Maintenance Rack & Stack Power HVAC, Net Apps Optimization Scaling HA DB Backups DB Patches DB Installs OS Patches OS Installs Server Maintenance Rack & Stack Power HVAC, Net
www.rdx.com 9 © 2018 • Objectives – Cloud only, cloud first, best fit, non-critical • Budgetary – Strategy development, architecture selection, implementation, mature system support, toolsets, training, existing datacenter, servers and related hardware • Architecture – IaaS, DBaaS, App PaaS, SaaS, multi-cloud, hybrid • Application – Replace, redevelop, optimize, minimal changes, new application design • Provider Sourcing and Selection – Features, pricing, maturity, lock-in, known vendor • Organizational – Support units, new roles, hiring, training, governance • Supporting Technologies – Application development languages, network, toolsets • Regulatory Compliance – Internal, industry, governmental Security, auditing, recovery, disaster recovery, toolsets, third-party applications, application design, governance, change control, naming conventions, data transfers… New Strategies and Standards Will Be Created StrategiesStandards
www.rdx.com 10 © 2018 Policies and Procedures Will Change Security, disaster recovery, change management, monitoring, problem resolution, job scheduling, administrative best practices, repeatable processes, internal, industry specific, governmental regulatory compliance, naming conventions – [[add required documentation here]]…
www.rdx.com 11 © 2018© 2018 CHOOSE THAT VENDOR WISELY You Will Share Responsibility with a Third Party Provider for the Security, Availability, Performance and Recoverability of Your DBMS
www.rdx.com 12 © 2018 Types of Cloud Platforms On-Premise • Server is onsite at your physical plant • You provide server room, power, air, connectivity… • YOU support all hardware • YOU support all software from OS up, including database • Server is hosted by a provider • You rent their hardware • They provide server room, power, air, connectivity…. • PROVIDER supports hardware • YOU provide and support all software from OS up, including database • Server is hosted by a provider • You rent their hardware • They provide server room, air, connectivity…. • PROVIDER supports hardware • YOU RENT the OS and database • PROVIDER supports OS and database software DBaaSIaaS
www.rdx.com 13 © 2018 IaaS vs DBaaS Infrastructure-as-a-Service • Some conversion costs • Have to purchase DB licenses, BYOL/rent OS license options • Able to install any software you choose – databases, applications, third-party tools • Easy to integrate your on-premises toolsets – monitoring, security, application development • Allows you to maintain tight control of OS and DB configuration • Tight control over database and OS utility execution – backups, index maintenance, patching, upgrades • Able to leverage cloud benefits that include elasticity, scalability and flexibility • Able to leverage features to reduce administrative time (varies according to vendor and particular offering selected Database-as-a-Service • Database products are limited by vendor offering • Rental fees include DB and OS • Provider assumes greater administrative control over your environment (software installation, DB and OS configuration, patching, DB upgrades) • Complex systems (HA, DR) are more easily configured • Data geo-redundancy is often inherent to offering • Provides backup and maintenance utility automations • Pricing can be complex and is configured by selecting tiers based on CPU, memory, I/O, and disk consumption • If you are renting the software, when relationship is over, you don’t own anything
www.rdx.com 14 © 2018© 2018 Creating Your Cloud Architecture Strategy • What is your cloud strategy? • Testing the waters • Choose between cloud and on-premises for best fit • Intend to have a strong cloud presence • Cloud first • What cloud benefits do you want to leverage? • Reduce hardware/software costs • Reduce human support costs • Focus on business, not system support • Improve performance and availability • Increase flexibility and agility • Faster application time-to-market • Quickly leverage complex architectures • What is your experience level with cloud systems? • How big of an impact (change management, training, polices/procedures, roles/responsibilities) on your IT shop are you willing to incur? • What application development platforms do you use? • How much control do you want to relinquish and how much responsibility for your systems are you comfortable sharing? • What on-premises software tools do you use? • Is your data controlled by internal, industry-specific or governmental regulatory requirements? • How sensitive is the data you are storing? • What auditing requirements are you required to meet? • Do you standardize on one DB vendor or support multiple? • Do you want to consolidate with one cloud provider or are you comfortable with multiple? • Do you intend to migrate DB, apps or both? • What amount of DB and app changes are you willing to make to migrate the system to the cloud? • What is your budget? • Retrain staff, organizational role and unit changes • Changes to process and documentation • Changes for application rewrites, cloud data transfers, on- premises/cloud DB feature mismatch • What are your HA and DR requirements?
www.rdx.com 15 © 2018 Single vs Multi-Tenant IaaS Multi-Tenant IaaS • Less expensive than Single-Tenant IaaS • Cloud provider assumes greater degree of ownership • Share computing resources with other tenants • Often provides more automations than single tenant Single Tenant IaaS • More expensive than Multi-Tenant IaaS • Customer assumes greater degree of ownership • Cloud provider assigns dedication resources to single tenant • Good for clients that adhere to strict regulatory compliance • Easier to transfer on-premises licenses • Still able to easily scale resource allocations • Predictable performance Host Hardware Hyper-Visor V M 4 V M 1 VM3 VM2 Host Hardware Hyper-Visor V M 4 V M 1 VM3 VM2
www.rdx.com 16 © 2018© 2018 Microsoft Azure Cloud DB Offerings Azure DBaaS Databases CosmosDB Warehouse SQL Data Table Storage
www.rdx.com 17 © 2018© 2018 Amazon RDS Databases https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/CHAP_SQLServer.html
www.rdx.com 18 © 2018© 2018 Coding, Administration and Testing 100% App Code Transportability Database Features DBaaS Product Features and Functionality Don’t Always Match On-Premises Counterparts
www.rdx.com 19 © 2018© 2018 SQL Server On-Premises vs Amazon RDS Feature Differences • Always On • Stretch Database • Backing up to Microsoft Azure Blob Storage • Buffer Pool extension • BULK INSERT and OPENROWSET(BULK...) features • Data Quality Services • Database Log Shipping • Database Mail • Distributed Queries (i.e., Linked Servers) • Distribution Transaction Coordinator (MSDTC) • File Tables • FILESTREAM support • Maintenance Plans • Performance Data Collector • Policy-Based Management • PolyBase • R • Replication • Resource Governor • SQL Server Audit • Server-level Triggers • Service Broker endpoints • T-SQL Endpoints (all operations using CREATE ENDPOINT are unavailable) • WCF Data Services https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/CHAP_SQ LServer.html
www.rdx.com 20 © 2018© 2018 RDX Recommendation • Always On Avail Groups • Attach a Database • BACKUP Command • Change Data Capture* • Cross Database Queries* • Cross Database Transactions* • Database Mail* • Database Mirroring https://docs.microsoft.com/en-us/azure/sql-database/sql-database-features • Database Snapshots • Event Notifications • Distributed Transactions • Extended Stored Procedures • Filestream • Linked Servers • Log Shipping • Polybase • Policy Based Management • RESTORE Command* • Semantic Search • Service Broker* • SQL Server Agent* • SQL Server Profiler* • Windows Server Failover Clustering SQL Server On-Premises vs Azure SQL DB Feature Differences * Available in Managed Instances
www.rdx.com 21 © 2018© 2018 Cloud systems will require changes to your support team’s organizational infrastructure. DB and application architects play an important role in the selection, configuration and implementation of public cloud based DBMS platforms. Personnel must be dedicated to learn and fully understand how to use the chosen vendor’s configuration, provisioning and administration services. Cloud Database Systems Require New Roles and Responsibilities
www.rdx.com 22 © 2018© 2018 Sharing Security With Your Cloud Provider DOESN’T MEAN YOU TURN TOTAL RESPONSIBILITY OVER TO YOUR VENDOR SECURITY TEAMS WILL USE DIFFERENT SECURITY/AUDITING TOOLS EXISTING POLICIES WILL CHANGE AND NEW POLICIES WILL BE CREATED • Databases • Standbys • Read Replicas • Load Files • Work Files • Reports • Data Transfers • Backups • Vendor Analysis • Security Controls • Regulatory Compliance • Auditing • Encryption • Event Notification • Incident Response
www.rdx.com 23 © 2018 Your Costing Models Will Change and Become More Complex • # Instances • # Regions • On-Demand/Reserved • Licensing Model • Computing Resources • Storage Amount • Storage Type • Backup Retention • Data Transfers • IOPS • Failover Configuration • Additional Monitoring YOU MUST UNDERSTAND WHAT YOU ARE BEING CHARGED FOR YOU MUST UNDERSTAND WHAT YOU ARE BEING CHARGED FOR • # Instances • # Regions • On-Demand/Reserved • Licensing Model • Computing Resources • Storage Amount • Storage Type • Backup Retention • Data Transfers • IOPS • Failover Configuration • Additional Monitoring Greater Impact DBaaS Less Impact IaaS
www.rdx.com 24 © 2018© 2018 Amazon Cost Calculator – What If Scenarios DB Product Pricing Page
www.rdx.com 25 © 2018© 2018 • Payment Options • On-Demand • No commitment • Pay by the hour • More expensive than reserved • Estimate usage per month • Reserved Instance • 1 and 3 year terms • More you pay up-front = more cost effective • Estimate usage per month • BYOL vs Rent Database • Database Edition • Will affect instance Class available (and costs) • I.E – SQL Server Enterprise vs SQL Server Web Edition • DB Instance Classes • Examples: db.m4.xlarge, db.t2.small • Controls • # of virtual CPUs • ECU – horsepower of Virtual CPUs • Allocated memory in Gibibytes • Ability to leverage Virtual Private Cloud • EBS Capable – volumes get dedicated additional I/O • Max bandwidth in megabits/second • Network performance • DB = Instance • Alpha Character describing instance • M = Standard Instance Class • Provides a balance of compute, memory, and network resources • R = Memory Optimized Class • Memory intensive instance (like a DBMS) • T = Baseline Performance Level Class with ability to burst to full CPU utilization • Numeric value describing generation • Higher number = more current generation • Better resource utilization reduces costs • Keyword describing resource allocations (performance) db.m4.10xlarge Amazon Costing Factors
www.rdx.com 26 © 2018© 2018 Amazon Data Transfer Charges • Amazon provides detailed pricing pages for every RDS DB product they offer • Link is provided in upcoming slide • REVIEW the pricing overview and database product specific pages • At the bottom of the DB specific pricing page, you will see data transfer costs • There are some transfers that you think you will pay for – but you won’t • Vice/Versa for other data transfer costs • These can change • Most costs are minimal, but its all dependent on data volumes Amazon Total Costs Include Data Transfer
www.rdx.com 27 © 2018© 2018 Database Transaction Units https://azure.microsoft.com/en-us/pricing/calculator/ Azure SQL DB DTU Cost Calculations • Region • Single DB, Elastic Pool • Basic, Standard or Premium Service Tier • Performance Level • Number of databases or pools • Hours, Days, Months • Long term Retention • Weekly, Monthly, Yearly backup retention • Can purchase additional storage • Charged for outbound data transfers • Secondary active geo-replication databases are priced at 100 percent of primary database prices The cost of geo-replication traffic is included • Advanced Threat Protection is an additional cost
www.rdx.com 28 © 2018 Cloud DBMS Charges - Don’t Get Surprised!  UNDERSTAND the vendor’s pricing models – they can be complex  MEASURE your current and estimate future workloads  TAKE YOUR TIME during configuration  MONITOR consumption daily  BE PREPARED to quickly adjust your configuration  SET UP billing alerts
www.rdx.com 29 © 2018© 2018 YOU WILL BE REQUIRED TO ADJUST YOUR CHANGE MANAGEMENT PROCESSES AND DOCUMENTATION Cloud Databases Are Administered Differently than On-Premises Systems Greater Impact DBaaS Less Impact IaaS
www.rdx.com 30 © 2018© 2018 Amazon Oracle Database Configuration
www.rdx.com 31 © 2018© 2018 YOU WILL NEED TO IDENTIFY WHICH OF YOUR EXISTING TOOLSETS WORK – AND WHICH ONES DON'T Cloud Development, DB Admin and Monitoring Mechanisms Are Different than On-Premises
www.rdx.com 32 © 2018 Amazon RDS Toolsets AWS Management Console • Used as starting point to manage all of your Amazon services • Provides links to individual service consoles (compute, storage, security, application and RDS) • Able to perform a wide range of monitoring and administration activities • Mobile application available • Able to organize services into resource groups and apply changes to all members • Can use tags to create custom resource groups RDS Console • Focus is on database management and monitoring • Can create database events for notifications (availability, security, recovery status..) • Able to activate RDS Enhanced Monitoring for more detailed diagnostic information • Provides a recommendations page that offers hints and tips to improve your RDS environment’s performance, availability and security • Performance Insights, a very robust performance drilldown tool for SQL Server is coming CloudWatch • CloudWatch monitors your Amazon environment including RDS • Provides system wide visibility • Able to access metrics from console, CLI, API and SDK • RDS sends metrics to CloudWatch every 60 seconds • RDS metrics include burst balance, CPU, memory, connection, IOPs, read/write latency… • Able to create CloudWatch alarms based on events and thresholds
www.rdx.com 33 © 2018© 2018 Performance Monitoring • Traditional tuning strategy of starting with high-level information and drilling down into specific details • Robust array of performance monitoring dashboards, drilldowns, metrics and visuals • Query Performance Insights accesses the Query Store to provide individual query performance data and recommendations • Create monitoring metric threshold alerts (DTU, CPU, I/O, failed connections, storage) • Metrics can be logged to Azure Event Hubs, Azure Log Analytics and Azure Storage * Source: https://docs.microsoft.com/en-us/azure/sql-database/sql- database-performance Azure SQL DB Query Performance Insights*
www.rdx.com 34 © 2018© 2018 Recommendations: • Cost reduction • Performance • Security • Availability Cloud Advisors
www.rdx.com 35 © 2018 Administration Amazon RDS Features Environment • Pay for what you use • Free tiers available to evaluate environment • Pay as you go and reserved options • Robust cost monitoring and billing alerts • Many different, global regions to choose from • Robust compute and storage environment • Many different sizing and configuration options available • Able to configure storage, IO, CPU/MEM separately • Ability to scale resource allocations • Offers DB and OS licenses as part of rental • Operating system and database installed and ready for use • Support for SQL Server (2008 R2, 2012, 2014, 2016, and 2017) including Express, Web, Standard and Enterprise • Provides many of the inherent on-premises DB product features • Includes administrative interfaces and monitoring tools • Able to add custom monitoring metrics • Initially configures DB with ability to customize parameters • Patches and upgrades OS and DB software • Automated and manual (snapshot) backups • Able to configure backup retention • Multi-Availability Zones facilitate HA deployments • Automatic failure detection • Automatic replacement of compute instance in the event of a hardware failure • Able to leverage Virtual Private Cloud to provide network isolation • Identity Access Management provides resource access control • SSL certificates are automatically generated • Key Management Service encrypts data at rest/in-transit • Also supports SQL Server Transparent Data Encryption (TDE) • Record and audit DB instance changes using AWS Config • Configurable maintenance windows • Traditional access tools (SSMS, SQL Workbench) can be used • SQL Server Agents are available
www.rdx.com 36 © 2018 Administration Azure SQL DB Features Environment • Pay for what you use • Free tiers available to evaluate environment • Two pricing models – vCore and DTU based • Robust cost monitoring and billing alerts • Many global regions available • Robust compute and storage environment • Many different sizing and configuration options available • Able to configure compute and storage separately (vCore only) • Ability to easily scale resource allocations • Azure Hybrid Benefit allows you to use on-premises licenses to reduce cloud licensing costs • Provides many of the inherent on-premises DB product features • Includes administrative interfaces and monitoring tools customized for Azure SQL DB • Able to add custom monitoring metrics • Managed Instances combine DBaaS benefits with on-premises compatibility • Patches and upgrades OS and DB software • Automated and manual backups • Able to configure backup retention • Offers elastic pools which allows a group of DBs to share resources • Intelligent advisors provide tuning recommendations • Auto tuning capabilities include auto index management and automatic plan correction • Read scale out and sharding provides horizontal scalability • Robust HA options available • Advanced Threat Protection provides data classification, vulnerability scanning and threat monitoring • Advanced security options include Transparent Data Encryption, Always Encrypted and Data Masking • Able to leverage Virtual Private Network to provide network isolation
www.rdx.com 37 © 2018© 2018 Amazon Infrastructure* * Source https://aws.amazon.com/about-aws/global-infrastructure/
www.rdx.com 38 © 2018© 2018 Amazon RDS Environment Availability Zone RDS Standby Instance Mirroring Availability Zone RDS Primary Instance Failover • Instance is your DB environment • Costing based on instance hours, storage, I/O, backup storage, data transfer per month • Scale resources up/down at instance level • Multi-AZ is optional but highly recommended • Uses SQL Server Database Mirroring for Multi-AZ, which Microsoft is replacing with Always On (Amazon currently does not support Always On) • Availability Zones are independent locations in a region • Multi-AZ with mirroring supports one standby mirror • Standby mirrors can not be used for read access • Redirecting connections does not require manual intervention • Can not create standby in different region • DB instance event generated during failover DescriptionAWSRegion
www.rdx.com 39 © 2018© 2018 * Source: https://azure.microsoft.com/en-us/regions/ Azure Regions Azure Infrastructure*
www.rdx.com 40 © 2018 Azure High Availability Options • Offers standard/general purpose and premium/business critical availability options • Standard/General Purpose - provides 99.99% of availability but with some potential performance degradation during maintenance activities • Premium/Business Critical - also provides 99.99% availability with minimal performance impact on your workload even during maintenance activities • Premium’s high availability feature is implemented using standard Always On Availability Groups • Can use replica for read only access • All systems must be in the same region • Able to configure traditional and geo-replicated backups • Database restoration Estimated Recovery Times and Recovery Time Objectives are influenced by service tier selection • Active geo-replication is available on all tiers and provides up to 4 secondaries with read access • Manual failover from 1 of 4 readable secondaries in same or different region. Need to update connection strings to point to new primary • Other secondaries are auto-linked to new primary • Azure SQL DB Failover Groups (extension of geo- replication) • Systems can be in same or different regions • Readable secondaries • One failover secondary in a different region is used for automatic failover • Configure auto-failover polices that trigger activation • Configure one address that does not need to be updated during failover. Like a Windows Cluster Name…
www.rdx.com 41 © 2018© 2018 THERE IS A LEARNING CURVE THAT VARIES ACCORDING TO VENDOR Don’t Expect Your Staff to Become Cloud DBMS Experts Overnight • Migration • Data Access • Data Transfer • High Availability • Backups • Restores • Performance Tuning • Troubleshooting • Costing • Storage • Compute • Provisioning • Administering • Security • Monitoring Tools • Admin Tools Greater Impact DBaaS Less Impact IaaS
www.rdx.com 42 © 2018 1. Database importance 2. Database usage (customer facing, LOB, back office) 3. Frequency of application development activity and schema changes 4. Database features utilized 5. Dependency and interaction with other systems • Flat file loads • Sends data to/receives data from other systems • Data used to refresh other systems • DB links used to access other databases 6. What level of modifications are you comfortable with? • Lift and shift • Limited changes • Changes to APIs, connection mechanisms • Total application rewrite to leverage new technologies 7. What on-premises software tools interact with DB? • Monitoring, application development, security 8. Performance requirements • Stable workloads or spikes/seasonal peaks? 9. Monitoring requirements 10. Security 11. Is data controlled by internal, industry-specific or governmental regulatory requirements? 12. What auditing requirements are you required to meet? 13. What is the database footprint and workloads? • Disk storage – How much data? • Concurrent users • CPU and memory consumption • I/O 14. High availability requirements 15. Backup requirements (frequency, # historical copies) 16. Disaster recovery requirements Selecting Databases For Migration
www.rdx.com 43 © 2018 The more interaction the DB has with on-premises systems, the more complicated support becomes Flat File Loads Input from other DB Apps Large Output Files Sent to Other Systems Output to Other DB Apps Data Clones and Refreshes New Data Transfer Mechanisms New Data Transfer Procedures No Database is an Island
www.rdx.com 44 © 2018 Where Will Your Apps Reside? Achieving acceptable response times for online transactions will be a challenge if your application programs are on-premises and your DB is in the cloud. You will need evaluate the type of application and its performance requirements before you migrate its database to the cloud. Robust performance test plans will be required.
www.rdx.com 45 © 2018© 2018 • Acceptable Outage Length • On-Premises OS and DB Version • Converting to Different DB Product • Bandwidth • Data Volumes • Update Frequency • Database Complexity • DB Product Specific Features • Vendor Cloud Migration Utilities • Security Considerations When Selecting Migration Mechanisms Greater Impact DBaaS Less Impact IaaS
www.rdx.com 46 © 2018 Amazon Database Migration ServiceAmazon Schema Conversion Tool • SCT is free to use • Converts schema objects including tables, indexes, views, stored procedures, and functions • Scans application source code to identify and convert SQL statements • Compares database schemas • Use mapping rules to change data types, move and rename objects, add/replace/remove prefixes and suffixes for databases, schemas, tables and columns • Generates schema conversion reports listing objects that can not be converted • Generates SQL statement conversion reports listing code that can not be converted • Extension pack allows you to emulate on-premises DB functions (job scheduling, email using Lambda functions) • Amazon provides common conversions issue for each DB product • Pricing is per hour based on instance size • Target = Aurora Free for 6 months. 9 with extension • Creates only those schema objects required to successfully replicate data • Seeds data and then replicates changes • Able to monitor data transfer problems and performance issues • Can create an assessment report for migration tasks that could affect migration process • Can choose objects to be migrated • Can limit rows migrated (good for initial testing • Filter based on column values • Amazon provides several security features to protect data transfers • Able to activate data validation which is performed after each table is migrated (adds time to process) Amazon DBaaS Migration Tools
www.rdx.com 47 © 2018© 2018 Microsoft DBaaS Migration Utilities Data Migration Assistant • Downtime required • Identifies cloud compatibility issues • DMA can also perform the analysis and generate report on what is not compatible with Azure SQL Database (DBaaS) without executing migration • Migrates schema, data, users, server roles and logons Data Migration Service • Uses output generated by Data Migration Assistant • Azure Portal Service that converts databases from on-premises to cloud • Provides ongoing replication to synchronize on-premises and cloud databases • Source: currently supports SQL Server, Oracle and MySQL • Target: Azure SQL DB Transactional Replication • No downtime • Azure SQL Database becomes a subscriber to the SQL Server on-premises instance • Requires that a new snapshot be taken and applied • Database can be online but it may impact performance • Perform snapshot off-hours
www.rdx.com 48 © 2018 Database Migration Steps * Robust Test Plans Required! Verification Cutover SynchronizationInitial Evaluation Migrate Structure Planning
www.rdx.com 49 © 2018© 2018 THE HARDER IT IS TO SWITCH VENDORS The More You Have to Tailor Your Database/Application to Work With Your Chosen Cloud Architecture
www.rdx.com 50 © 2018© 2018 ARE YOU READY FOR A CLOUD OUTAGE?
www.rdx.com 51 © 2018© 2018 Select the Appropriate Database Driven Applications for the Cloud Have a Cloud Strategy: Migration/Testing/Ongoin g Support Plans Thoroughly Understand and Evaluate Competing Offerings Recognize That They Are Supported Differently than On-Premises Counterparts RDX Cloud DBMS Recommendations
www.rdx.com 52 © 2018 RDX’s Goal is to Become the Cloud Advisor Our Customers Can’t Do Without What We Learn From Our Customers You may not want to do that… • Support best practices • Security procedures • Best architecture implementations • Product selection, implementation and usage • What products work together • Software combinations (best Tech Stack) • Recurring issues • Problem prevention Benefits All Customers
November Presentation Microsoft Power BI Overview and Demo – Thursday, December 6th The RDX Report Top 10 DBaaS Migration Mistakes, RightScale Cloud Comparison Tool, Rise of Open Source Cloud Databases LinkedIn Will You Be Replaced by a Robot?, Selecting Cloud DBMS, NoSQL Architectures, Database Security Series, Improving Customer Service 20YEARS OF SERVICE DELIVERY EXPERIENCE cfoot@rdx.com

More Related Content

PPTX
Selecting a SQL Server Cloud Platform - IaaS, Amazon RDS or Azure SQL DB?
byChristopher Foot
 
PPTX
Migrating On-Premises DBs to Cloud Systems
byChristopher Foot
 
PPTX
Introduction to Azure SQL DB
byChristopher Foot
 
PPTX
CSC AWS re:Invent Enterprise DevOps session
byTom Laszewski
 
PPTX
Azure Data platform
byMostafa
 
PPTX
Accenture Oracle on AWS Jumpstart Program
byTom Laszewski
 
PDF
Microsoft azure - the cloud for modern business
byVinh Nguyen Quang
 
PPTX
Evaluating Cloud Database Offerings
byChristopher Foot
 
Selecting a SQL Server Cloud Platform - IaaS, Amazon RDS or Azure SQL DB?
byChristopher Foot
 
Migrating On-Premises DBs to Cloud Systems
byChristopher Foot
 
Introduction to Azure SQL DB
byChristopher Foot
 
CSC AWS re:Invent Enterprise DevOps session
byTom Laszewski
 
Azure Data platform
byMostafa
 
Accenture Oracle on AWS Jumpstart Program
byTom Laszewski
 
Microsoft azure - the cloud for modern business
byVinh Nguyen Quang
 
Evaluating Cloud Database Offerings
byChristopher Foot
 

What's hot

PPTX
Veritas - Software Defined Storage
byJürgen Ambrosi
 
PPT
Basics of Java Cloud
byAnkur Gupta
 
PPTX
Azure SQL Database & Azure SQL Data Warehouse
byMohamed Tawfik
 
PPTX
Ppt on cloud service
byJYOTIRANJANNAYAK18
 
PDF
Azure SQL Database Managed Instance - technical overview
byGeorge Walters
 
PPTX
Cisco integrated system for microsoft azure stack
byAymen Mami
 
PDF
IBM Storage for Analytics, Cognitive and Cloud
byTony Pearson
 
PPT
Managed Cloud Services for Siebel CRM on Amazon AWS
byMilind Waikul
 
PPTX
Azure Stack Overview (Dec/2018)
byCenk Ersoy
 
PDF
Informix into the future13 july2017
byShawn Moe
 
PDF
The Evolution of SQL Server as a Service - SQL Azure Managed Instance
byJavier Villegas
 
PDF
Cloud application architecture with Microsoft Azure
byGuillermo Zepeda Selman
 
PPTX
Cloud's Hidden Impact on IT Support Organizations
byChristopher Foot
 
PPTX
Who Will Win the Database Wars?
byChristopher Foot
 
PPTX
App Associates : Leveraging AWS for Oracle Workloads
byTom Laszewski
 
PPTX
Consolidating File Servers into the Cloud
byBuurst
 
PPTX
Software as a Service
byholmaond
 
PPTX
Eucalyptus-AWS Hybrid Using RightScale myCloud
byRightScale
 
Veritas - Software Defined Storage
byJürgen Ambrosi
 
Basics of Java Cloud
byAnkur Gupta
 
Azure SQL Database & Azure SQL Data Warehouse
byMohamed Tawfik
 
Ppt on cloud service
byJYOTIRANJANNAYAK18
 
Azure SQL Database Managed Instance - technical overview
byGeorge Walters
 
Cisco integrated system for microsoft azure stack
byAymen Mami
 
IBM Storage for Analytics, Cognitive and Cloud
byTony Pearson
 
Managed Cloud Services for Siebel CRM on Amazon AWS
byMilind Waikul
 
Azure Stack Overview (Dec/2018)
byCenk Ersoy
 
Informix into the future13 july2017
byShawn Moe
 
The Evolution of SQL Server as a Service - SQL Azure Managed Instance
byJavier Villegas
 
Cloud application architecture with Microsoft Azure
byGuillermo Zepeda Selman
 
Cloud's Hidden Impact on IT Support Organizations
byChristopher Foot
 
Who Will Win the Database Wars?
byChristopher Foot
 
App Associates : Leveraging AWS for Oracle Workloads
byTom Laszewski
 
Consolidating File Servers into the Cloud
byBuurst
 
Software as a Service
byholmaond
 
Eucalyptus-AWS Hybrid Using RightScale myCloud
byRightScale
 

Similar to Cloud's Hidden Impact on IT Shops

PPTX
Comparison of Cloud Providers
bySabapathy Murthi
 
PPTX
Cloud Computing
bySusan Winters
 
PDF
Intro to cloud.pdf
bySawanBhattacharya
 
PDF
PSee Solutions
byKatieDew2
 
PDF
Databases in the hosted cloud
byColin Charles
 
KEY
The sky's the limit
byIvan Zoratti
 
PPTX
Top Considerations When Deciding Between Cloud Apps, Cloud Infrastructure or ...
byDatavail
 
PPTX
Journey to the Cloud: What I Wish I Knew Before I Started
byDatavail
 
PPTX
Journey to the Cloud: What I Wish I Knew Before I Started
byDatavail
 
PPTX
Cloud computing overview
byDimitar Georgiev
 
PPTX
Moving Oracle Applications to the Cloud - Which Cloud is Right for Me?
byDatavail
 
PPT
Cloud computing
bygd1410
 
PDF
Idera live 2021: Managing Databases in the Cloud - the First Step, a Succes...
byIDERA Software
 
PPTX
Making the Cloud a Known Entity
byKellyn Pot'Vin-Gorman
 
PDF
JD Edwards in the Cloud - Flipbook: What are your peers doing?
byManageForce
 
PDF
Comparison of Several IaaS Cloud Computing Platforms
byijsrd.com
 
PPTX
Database Migrations to the Cloud
byKellyn Pot'Vin-Gorman
 
PPTX
Cloudy with a Chance of Databases
byKellyn Pot'Vin-Gorman
 
PDF
CirrusDB Cloud Effect
byAshok Sami
 
PDF
Databases in the Hosted Cloud
byColin Charles
 
Comparison of Cloud Providers
bySabapathy Murthi
 
Cloud Computing
bySusan Winters
 
Intro to cloud.pdf
bySawanBhattacharya
 
PSee Solutions
byKatieDew2
 
Databases in the hosted cloud
byColin Charles
 
The sky's the limit
byIvan Zoratti
 
Top Considerations When Deciding Between Cloud Apps, Cloud Infrastructure or ...
byDatavail
 
Journey to the Cloud: What I Wish I Knew Before I Started
byDatavail
 
Journey to the Cloud: What I Wish I Knew Before I Started
byDatavail
 
Cloud computing overview
byDimitar Georgiev
 
Moving Oracle Applications to the Cloud - Which Cloud is Right for Me?
byDatavail
 
Cloud computing
bygd1410
 
Idera live 2021: Managing Databases in the Cloud - the First Step, a Succes...
byIDERA Software
 
Making the Cloud a Known Entity
byKellyn Pot'Vin-Gorman
 
JD Edwards in the Cloud - Flipbook: What are your peers doing?
byManageForce
 
Comparison of Several IaaS Cloud Computing Platforms
byijsrd.com
 
Database Migrations to the Cloud
byKellyn Pot'Vin-Gorman
 
Cloudy with a Chance of Databases
byKellyn Pot'Vin-Gorman
 
CirrusDB Cloud Effect
byAshok Sami
 
Databases in the Hosted Cloud
byColin Charles
 

Recently uploaded

PDF
DUBAI IT MODERNIZATION WITH AZURE MANAGED SERVICES.pdf
byLogicEra
 
PDF
Dev Dives: Build smarter agents with UiPath Agent Builder
byUiPathCommunity
 
PDF
MuleSoft Meetup: Dreamforce'25 Tour- Vibing With AI & Agents.pdf
byTintu Jacob Shaji
 
PDF
Transforming Content Operations in the Age of AI
byEnterprise Knowledge
 
PDF
How Much Does It Cost to Build an eCommerce Website in 2025.pdf
byPixlogix Infotech
 
PDF
Mastering Agentic Orchestration with UiPath Maestro | Hands on Workshop
byUiPathCommunity
 
PDF
ODSC AI West: Agent Optimization: Beyond Context engineering
byShashikant Jagtap
 
PDF
[BDD 2025 - Full-Stack Development] PHP in AI Age: The Laravel Way. (Rizqy Hi...
byWintari Yasmin
 
PDF
10 Best Automation QA Testing Software Tools in 2025.pdf
byRohitBhandari66
 
PPTX
kernel PPT (Explanation of Windows Kernal).pptx
byINFOBYTES1
 
PPTX
Connecting the unconnectable: Exploring LoRaWAN for IoT
byasasiraarthur
 
PDF
[BDD 2025 - Mobile Development] Mobile Engineer and Software Engineer: Are we...
bywintari3
 
PPTX
MuleSoft AI Series : Introduction to MCP
byMulesoftMunichMeetup
 
PDF
KMWorld - KM & AI Bring Collectivity, Nostalgia, & Selectivity
byJonathan Ralton
 
PDF
[BDD 2025 - Artificial Intelligence] AI for the Underdogs: Innovation for Sma...
byWintari Yasmin
 
PDF
[BDD 2025 - Mobile Development] Crafting Immersive UI with E2E and AGSL Shade...
byWintari Yasmin
 
PDF
Crane Accident Prevention Guide: Key OSHA Regulations for Safer Operations
bySharpEagle Technology
 
PDF
Transcript: The partnership effect: Libraries and publishers on collaborating...
byBookNet Canada
 
PDF
The Evolving Role of the CEO in the Age of AI
byPipal Tree Services Executive Search Firm
 
PDF
"DISC as GPS for team leaders: how to lead a team from storming to performing...
byFwdays
 
DUBAI IT MODERNIZATION WITH AZURE MANAGED SERVICES.pdf
byLogicEra
 
Dev Dives: Build smarter agents with UiPath Agent Builder
byUiPathCommunity
 
MuleSoft Meetup: Dreamforce'25 Tour- Vibing With AI & Agents.pdf
byTintu Jacob Shaji
 
Transforming Content Operations in the Age of AI
byEnterprise Knowledge
 
How Much Does It Cost to Build an eCommerce Website in 2025.pdf
byPixlogix Infotech
 
Mastering Agentic Orchestration with UiPath Maestro | Hands on Workshop
byUiPathCommunity
 
ODSC AI West: Agent Optimization: Beyond Context engineering
byShashikant Jagtap
 
[BDD 2025 - Full-Stack Development] PHP in AI Age: The Laravel Way. (Rizqy Hi...
byWintari Yasmin
 
10 Best Automation QA Testing Software Tools in 2025.pdf
byRohitBhandari66
 
kernel PPT (Explanation of Windows Kernal).pptx
byINFOBYTES1
 
Connecting the unconnectable: Exploring LoRaWAN for IoT
byasasiraarthur
 
[BDD 2025 - Mobile Development] Mobile Engineer and Software Engineer: Are we...
bywintari3
 
MuleSoft AI Series : Introduction to MCP
byMulesoftMunichMeetup
 
KMWorld - KM & AI Bring Collectivity, Nostalgia, & Selectivity
byJonathan Ralton
 
[BDD 2025 - Artificial Intelligence] AI for the Underdogs: Innovation for Sma...
byWintari Yasmin
 
[BDD 2025 - Mobile Development] Crafting Immersive UI with E2E and AGSL Shade...
byWintari Yasmin
 
Crane Accident Prevention Guide: Key OSHA Regulations for Safer Operations
bySharpEagle Technology
 
Transcript: The partnership effect: Libraries and publishers on collaborating...
byBookNet Canada
 
The Evolving Role of the CEO in the Age of AI
byPipal Tree Services Executive Search Firm
 
"DISC as GPS for team leaders: how to lead a team from storming to performing...
byFwdays
 

Cloud's Hidden Impact on IT Shops

  • 1.
    www.rdx.com 1 © 2018 STRATEGIES COMPLIANCESECURITY PERFORMANCE CHANGE MANAGEMENT COSTING EDUCATION ADMINISTRATION MONITORING DATA TRANSFERS ORGANIZATIONAL ROLES THIRD-PARTY/IN-HOUSE APPS IN-HOUSE TOOLS STANDARD OPERATING PROCEDURES SUPPORT DOCUMENTATION Cloud DB Systems’ Hidden Impact on IT They Will Be Greater Than You Think
  • 2.
    www.rdx.com 2 © 2018© 2018 20 YEARSOF SERVICE DELIVERY EXPERIENCE Database Platforms SQL Server Oracle PostgreSQL* DB2 MongoDB* MySQL* Operating Systems Unix/Linux*Windows Enterprise Applications SQL Server BI Oracle EBS SharePoint Exchange Environment 800+ Customers 20,000 DBs 200+ DBAs Fortune 100s Startups All Verticals Cloud Systems Amazon AWS/RDS Oracle Cloud DB DBaaS Msoft Azure IaaS Multi-Cloud * All distributions The Largest Pure Play Provider of Managed Data Infrastructure Services
  • 3.
    www.rdx.com 3 © 2018© 2018 Database Administration CloudMigration & Administration Operating System Support Business Intelligence & Reporting Business Applications Support Monitoring & Problem Resolution Full SupportSupplemental Support Core Services
  • 4.
    www.rdx.com 4 © 2018© 2018 IncludingCloud DBaaS and IaaS Environments Database & OS Maintenance Backup & Recovery Installs, Upgrades & Patching Change Management Monitoring, Alerting & Event Management Performance Tuning Assessments & Health Checks Troubleshooting Database Security & Auditing High Availability System Design & Deployment Cloud Migrations and Support Advanced Architectures Strategic Planning
  • 5.
    www.rdx.com 5 © 2018© 2018 CloudDBs are Architectures - Not Products Offerings Range from Simple to Rocket Science Cloud DBs Impact on Support > What Most Think Not all DB Apps are “Cloud Friendly” Here’s What We’ve Learned Working With Cloud DBs
  • 6.
    www.rdx.com 6 © 2018© 2018 Thereare Many Different Cloud DBMS Offerings and Pricing Models IAAS
  • 7.
    www.rdx.com 7 © 2018 Auditing andCompliance OSConfiguration Disk Configuration CPU Pricing Models Monitoring Memory Administration Access Mechanisms ArchitectureDesign Policies&Procedures Tools Training Security EdgeTechnologies Backup/Recovery StaffRoles Redundancy Provisioning Tuning Cloud DB Systems are Architectures, Not Products
  • 8.
    www.rdx.com 8 © 2018© 2018 YouWill Need to Thoroughly Evaluate The Impact Those Changes Will Make Fully Investigate Cloud Platform • Pricing Models • Read Fine Print! • Vendor Lock In • DB Features • Elasticity • Scalability • Site Locations • Track Record • Storage • Compute • Provisioning • Monitoring Tools • Admin Tools • Backup • Security • Data Access RDS EC2 Apps Optimization Scaling HA DB Backups DB Patches DB Installs OS Patches OS Installs Server Maintenance Rack & Stack Power HVAC, Net Apps Optimization Scaling HA DB Backups DB Patches DB Installs OS Patches OS Installs Server Maintenance Rack & Stack Power HVAC, Net
  • 9.
    www.rdx.com 9 © 2018 • Objectives– Cloud only, cloud first, best fit, non-critical • Budgetary – Strategy development, architecture selection, implementation, mature system support, toolsets, training, existing datacenter, servers and related hardware • Architecture – IaaS, DBaaS, App PaaS, SaaS, multi-cloud, hybrid • Application – Replace, redevelop, optimize, minimal changes, new application design • Provider Sourcing and Selection – Features, pricing, maturity, lock-in, known vendor • Organizational – Support units, new roles, hiring, training, governance • Supporting Technologies – Application development languages, network, toolsets • Regulatory Compliance – Internal, industry, governmental Security, auditing, recovery, disaster recovery, toolsets, third-party applications, application design, governance, change control, naming conventions, data transfers… New Strategies and Standards Will Be Created StrategiesStandards
  • 10.
    www.rdx.com 10 © 2018 Policies andProcedures Will Change Security, disaster recovery, change management, monitoring, problem resolution, job scheduling, administrative best practices, repeatable processes, internal, industry specific, governmental regulatory compliance, naming conventions – [[add required documentation here]]…
  • 11.
    www.rdx.com 11 © 2018© 2018 CHOOSETHAT VENDOR WISELY You Will Share Responsibility with a Third Party Provider for the Security, Availability, Performance and Recoverability of Your DBMS
  • 12.
    www.rdx.com 12 © 2018 Types ofCloud Platforms On-Premise • Server is onsite at your physical plant • You provide server room, power, air, connectivity… • YOU support all hardware • YOU support all software from OS up, including database • Server is hosted by a provider • You rent their hardware • They provide server room, power, air, connectivity…. • PROVIDER supports hardware • YOU provide and support all software from OS up, including database • Server is hosted by a provider • You rent their hardware • They provide server room, air, connectivity…. • PROVIDER supports hardware • YOU RENT the OS and database • PROVIDER supports OS and database software DBaaSIaaS
  • 13.
    www.rdx.com 13 © 2018 IaaS vsDBaaS Infrastructure-as-a-Service • Some conversion costs • Have to purchase DB licenses, BYOL/rent OS license options • Able to install any software you choose – databases, applications, third-party tools • Easy to integrate your on-premises toolsets – monitoring, security, application development • Allows you to maintain tight control of OS and DB configuration • Tight control over database and OS utility execution – backups, index maintenance, patching, upgrades • Able to leverage cloud benefits that include elasticity, scalability and flexibility • Able to leverage features to reduce administrative time (varies according to vendor and particular offering selected Database-as-a-Service • Database products are limited by vendor offering • Rental fees include DB and OS • Provider assumes greater administrative control over your environment (software installation, DB and OS configuration, patching, DB upgrades) • Complex systems (HA, DR) are more easily configured • Data geo-redundancy is often inherent to offering • Provides backup and maintenance utility automations • Pricing can be complex and is configured by selecting tiers based on CPU, memory, I/O, and disk consumption • If you are renting the software, when relationship is over, you don’t own anything
  • 14.
    www.rdx.com 14 © 2018© 2018 CreatingYour Cloud Architecture Strategy • What is your cloud strategy? • Testing the waters • Choose between cloud and on-premises for best fit • Intend to have a strong cloud presence • Cloud first • What cloud benefits do you want to leverage? • Reduce hardware/software costs • Reduce human support costs • Focus on business, not system support • Improve performance and availability • Increase flexibility and agility • Faster application time-to-market • Quickly leverage complex architectures • What is your experience level with cloud systems? • How big of an impact (change management, training, polices/procedures, roles/responsibilities) on your IT shop are you willing to incur? • What application development platforms do you use? • How much control do you want to relinquish and how much responsibility for your systems are you comfortable sharing? • What on-premises software tools do you use? • Is your data controlled by internal, industry-specific or governmental regulatory requirements? • How sensitive is the data you are storing? • What auditing requirements are you required to meet? • Do you standardize on one DB vendor or support multiple? • Do you want to consolidate with one cloud provider or are you comfortable with multiple? • Do you intend to migrate DB, apps or both? • What amount of DB and app changes are you willing to make to migrate the system to the cloud? • What is your budget? • Retrain staff, organizational role and unit changes • Changes to process and documentation • Changes for application rewrites, cloud data transfers, on- premises/cloud DB feature mismatch • What are your HA and DR requirements?
  • 15.
    www.rdx.com 15 © 2018 Single vsMulti-Tenant IaaS Multi-Tenant IaaS • Less expensive than Single-Tenant IaaS • Cloud provider assumes greater degree of ownership • Share computing resources with other tenants • Often provides more automations than single tenant Single Tenant IaaS • More expensive than Multi-Tenant IaaS • Customer assumes greater degree of ownership • Cloud provider assigns dedication resources to single tenant • Good for clients that adhere to strict regulatory compliance • Easier to transfer on-premises licenses • Still able to easily scale resource allocations • Predictable performance Host Hardware Hyper-Visor V M 4 V M 1 VM3 VM2 Host Hardware Hyper-Visor V M 4 V M 1 VM3 VM2
  • 16.
    www.rdx.com 16 © 2018© 2018 MicrosoftAzure Cloud DB Offerings Azure DBaaS Databases CosmosDB Warehouse SQL Data Table Storage
  • 17.
    www.rdx.com 17 © 2018© 2018 AmazonRDS Databases https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/CHAP_SQLServer.html
  • 18.
    www.rdx.com 18 © 2018© 2018 Coding,Administration and Testing 100% App Code Transportability Database Features DBaaS Product Features and Functionality Don’t Always Match On-Premises Counterparts
  • 19.
    www.rdx.com 19 © 2018© 2018 SQLServer On-Premises vs Amazon RDS Feature Differences • Always On • Stretch Database • Backing up to Microsoft Azure Blob Storage • Buffer Pool extension • BULK INSERT and OPENROWSET(BULK...) features • Data Quality Services • Database Log Shipping • Database Mail • Distributed Queries (i.e., Linked Servers) • Distribution Transaction Coordinator (MSDTC) • File Tables • FILESTREAM support • Maintenance Plans • Performance Data Collector • Policy-Based Management • PolyBase • R • Replication • Resource Governor • SQL Server Audit • Server-level Triggers • Service Broker endpoints • T-SQL Endpoints (all operations using CREATE ENDPOINT are unavailable) • WCF Data Services https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/CHAP_SQ LServer.html
  • 20.
    www.rdx.com 20 © 2018© 2018 RDXRecommendation • Always On Avail Groups • Attach a Database • BACKUP Command • Change Data Capture* • Cross Database Queries* • Cross Database Transactions* • Database Mail* • Database Mirroring https://docs.microsoft.com/en-us/azure/sql-database/sql-database-features • Database Snapshots • Event Notifications • Distributed Transactions • Extended Stored Procedures • Filestream • Linked Servers • Log Shipping • Polybase • Policy Based Management • RESTORE Command* • Semantic Search • Service Broker* • SQL Server Agent* • SQL Server Profiler* • Windows Server Failover Clustering SQL Server On-Premises vs Azure SQL DB Feature Differences * Available in Managed Instances
  • 21.
    www.rdx.com 21 © 2018© 2018 Cloudsystems will require changes to your support team’s organizational infrastructure. DB and application architects play an important role in the selection, configuration and implementation of public cloud based DBMS platforms. Personnel must be dedicated to learn and fully understand how to use the chosen vendor’s configuration, provisioning and administration services. Cloud Database Systems Require New Roles and Responsibilities
  • 22.
    www.rdx.com 22 © 2018© 2018 SharingSecurity With Your Cloud Provider DOESN’T MEAN YOU TURN TOTAL RESPONSIBILITY OVER TO YOUR VENDOR SECURITY TEAMS WILL USE DIFFERENT SECURITY/AUDITING TOOLS EXISTING POLICIES WILL CHANGE AND NEW POLICIES WILL BE CREATED • Databases • Standbys • Read Replicas • Load Files • Work Files • Reports • Data Transfers • Backups • Vendor Analysis • Security Controls • Regulatory Compliance • Auditing • Encryption • Event Notification • Incident Response
  • 23.
    www.rdx.com 23 © 2018 Your CostingModels Will Change and Become More Complex • # Instances • # Regions • On-Demand/Reserved • Licensing Model • Computing Resources • Storage Amount • Storage Type • Backup Retention • Data Transfers • IOPS • Failover Configuration • Additional Monitoring YOU MUST UNDERSTAND WHAT YOU ARE BEING CHARGED FOR YOU MUST UNDERSTAND WHAT YOU ARE BEING CHARGED FOR • # Instances • # Regions • On-Demand/Reserved • Licensing Model • Computing Resources • Storage Amount • Storage Type • Backup Retention • Data Transfers • IOPS • Failover Configuration • Additional Monitoring Greater Impact DBaaS Less Impact IaaS
  • 24.
    www.rdx.com 24 © 2018© 2018 AmazonCost Calculator – What If Scenarios DB Product Pricing Page
  • 25.
    www.rdx.com 25 © 2018© 2018 •Payment Options • On-Demand • No commitment • Pay by the hour • More expensive than reserved • Estimate usage per month • Reserved Instance • 1 and 3 year terms • More you pay up-front = more cost effective • Estimate usage per month • BYOL vs Rent Database • Database Edition • Will affect instance Class available (and costs) • I.E – SQL Server Enterprise vs SQL Server Web Edition • DB Instance Classes • Examples: db.m4.xlarge, db.t2.small • Controls • # of virtual CPUs • ECU – horsepower of Virtual CPUs • Allocated memory in Gibibytes • Ability to leverage Virtual Private Cloud • EBS Capable – volumes get dedicated additional I/O • Max bandwidth in megabits/second • Network performance • DB = Instance • Alpha Character describing instance • M = Standard Instance Class • Provides a balance of compute, memory, and network resources • R = Memory Optimized Class • Memory intensive instance (like a DBMS) • T = Baseline Performance Level Class with ability to burst to full CPU utilization • Numeric value describing generation • Higher number = more current generation • Better resource utilization reduces costs • Keyword describing resource allocations (performance) db.m4.10xlarge Amazon Costing Factors
  • 26.
    www.rdx.com 26 © 2018© 2018 AmazonData Transfer Charges • Amazon provides detailed pricing pages for every RDS DB product they offer • Link is provided in upcoming slide • REVIEW the pricing overview and database product specific pages • At the bottom of the DB specific pricing page, you will see data transfer costs • There are some transfers that you think you will pay for – but you won’t • Vice/Versa for other data transfer costs • These can change • Most costs are minimal, but its all dependent on data volumes Amazon Total Costs Include Data Transfer
  • 27.
    www.rdx.com 27 © 2018© 2018 DatabaseTransaction Units https://azure.microsoft.com/en-us/pricing/calculator/ Azure SQL DB DTU Cost Calculations • Region • Single DB, Elastic Pool • Basic, Standard or Premium Service Tier • Performance Level • Number of databases or pools • Hours, Days, Months • Long term Retention • Weekly, Monthly, Yearly backup retention • Can purchase additional storage • Charged for outbound data transfers • Secondary active geo-replication databases are priced at 100 percent of primary database prices The cost of geo-replication traffic is included • Advanced Threat Protection is an additional cost
  • 28.
    www.rdx.com 28 © 2018 Cloud DBMSCharges - Don’t Get Surprised!  UNDERSTAND the vendor’s pricing models – they can be complex  MEASURE your current and estimate future workloads  TAKE YOUR TIME during configuration  MONITOR consumption daily  BE PREPARED to quickly adjust your configuration  SET UP billing alerts
  • 29.
    www.rdx.com 29 © 2018© 2018 YOUWILL BE REQUIRED TO ADJUST YOUR CHANGE MANAGEMENT PROCESSES AND DOCUMENTATION Cloud Databases Are Administered Differently than On-Premises Systems Greater Impact DBaaS Less Impact IaaS
  • 30.
    www.rdx.com 30 © 2018© 2018 AmazonOracle Database Configuration
  • 31.
    www.rdx.com 31 © 2018© 2018 YOUWILL NEED TO IDENTIFY WHICH OF YOUR EXISTING TOOLSETS WORK – AND WHICH ONES DON'T Cloud Development, DB Admin and Monitoring Mechanisms Are Different than On-Premises
  • 32.
    www.rdx.com 32 © 2018 Amazon RDSToolsets AWS Management Console • Used as starting point to manage all of your Amazon services • Provides links to individual service consoles (compute, storage, security, application and RDS) • Able to perform a wide range of monitoring and administration activities • Mobile application available • Able to organize services into resource groups and apply changes to all members • Can use tags to create custom resource groups RDS Console • Focus is on database management and monitoring • Can create database events for notifications (availability, security, recovery status..) • Able to activate RDS Enhanced Monitoring for more detailed diagnostic information • Provides a recommendations page that offers hints and tips to improve your RDS environment’s performance, availability and security • Performance Insights, a very robust performance drilldown tool for SQL Server is coming CloudWatch • CloudWatch monitors your Amazon environment including RDS • Provides system wide visibility • Able to access metrics from console, CLI, API and SDK • RDS sends metrics to CloudWatch every 60 seconds • RDS metrics include burst balance, CPU, memory, connection, IOPs, read/write latency… • Able to create CloudWatch alarms based on events and thresholds
  • 33.
    www.rdx.com 33 © 2018© 2018 PerformanceMonitoring • Traditional tuning strategy of starting with high-level information and drilling down into specific details • Robust array of performance monitoring dashboards, drilldowns, metrics and visuals • Query Performance Insights accesses the Query Store to provide individual query performance data and recommendations • Create monitoring metric threshold alerts (DTU, CPU, I/O, failed connections, storage) • Metrics can be logged to Azure Event Hubs, Azure Log Analytics and Azure Storage * Source: https://docs.microsoft.com/en-us/azure/sql-database/sql- database-performance Azure SQL DB Query Performance Insights*
  • 34.
    www.rdx.com 34 © 2018© 2018 Recommendations: •Cost reduction • Performance • Security • Availability Cloud Advisors
  • 35.
    www.rdx.com 35 © 2018 Administration Amazon RDSFeatures Environment • Pay for what you use • Free tiers available to evaluate environment • Pay as you go and reserved options • Robust cost monitoring and billing alerts • Many different, global regions to choose from • Robust compute and storage environment • Many different sizing and configuration options available • Able to configure storage, IO, CPU/MEM separately • Ability to scale resource allocations • Offers DB and OS licenses as part of rental • Operating system and database installed and ready for use • Support for SQL Server (2008 R2, 2012, 2014, 2016, and 2017) including Express, Web, Standard and Enterprise • Provides many of the inherent on-premises DB product features • Includes administrative interfaces and monitoring tools • Able to add custom monitoring metrics • Initially configures DB with ability to customize parameters • Patches and upgrades OS and DB software • Automated and manual (snapshot) backups • Able to configure backup retention • Multi-Availability Zones facilitate HA deployments • Automatic failure detection • Automatic replacement of compute instance in the event of a hardware failure • Able to leverage Virtual Private Cloud to provide network isolation • Identity Access Management provides resource access control • SSL certificates are automatically generated • Key Management Service encrypts data at rest/in-transit • Also supports SQL Server Transparent Data Encryption (TDE) • Record and audit DB instance changes using AWS Config • Configurable maintenance windows • Traditional access tools (SSMS, SQL Workbench) can be used • SQL Server Agents are available
  • 36.
    www.rdx.com 36 © 2018 Administration Azure SQLDB Features Environment • Pay for what you use • Free tiers available to evaluate environment • Two pricing models – vCore and DTU based • Robust cost monitoring and billing alerts • Many global regions available • Robust compute and storage environment • Many different sizing and configuration options available • Able to configure compute and storage separately (vCore only) • Ability to easily scale resource allocations • Azure Hybrid Benefit allows you to use on-premises licenses to reduce cloud licensing costs • Provides many of the inherent on-premises DB product features • Includes administrative interfaces and monitoring tools customized for Azure SQL DB • Able to add custom monitoring metrics • Managed Instances combine DBaaS benefits with on-premises compatibility • Patches and upgrades OS and DB software • Automated and manual backups • Able to configure backup retention • Offers elastic pools which allows a group of DBs to share resources • Intelligent advisors provide tuning recommendations • Auto tuning capabilities include auto index management and automatic plan correction • Read scale out and sharding provides horizontal scalability • Robust HA options available • Advanced Threat Protection provides data classification, vulnerability scanning and threat monitoring • Advanced security options include Transparent Data Encryption, Always Encrypted and Data Masking • Able to leverage Virtual Private Network to provide network isolation
  • 37.
    www.rdx.com 37 © 2018© 2018 AmazonInfrastructure* * Source https://aws.amazon.com/about-aws/global-infrastructure/
  • 38.
    www.rdx.com 38 © 2018© 2018 AmazonRDS Environment Availability Zone RDS Standby Instance Mirroring Availability Zone RDS Primary Instance Failover • Instance is your DB environment • Costing based on instance hours, storage, I/O, backup storage, data transfer per month • Scale resources up/down at instance level • Multi-AZ is optional but highly recommended • Uses SQL Server Database Mirroring for Multi-AZ, which Microsoft is replacing with Always On (Amazon currently does not support Always On) • Availability Zones are independent locations in a region • Multi-AZ with mirroring supports one standby mirror • Standby mirrors can not be used for read access • Redirecting connections does not require manual intervention • Can not create standby in different region • DB instance event generated during failover DescriptionAWSRegion
  • 39.
    www.rdx.com 39 © 2018© 2018 *Source: https://azure.microsoft.com/en-us/regions/ Azure Regions Azure Infrastructure*
  • 40.
    www.rdx.com 40 © 2018 Azure HighAvailability Options • Offers standard/general purpose and premium/business critical availability options • Standard/General Purpose - provides 99.99% of availability but with some potential performance degradation during maintenance activities • Premium/Business Critical - also provides 99.99% availability with minimal performance impact on your workload even during maintenance activities • Premium’s high availability feature is implemented using standard Always On Availability Groups • Can use replica for read only access • All systems must be in the same region • Able to configure traditional and geo-replicated backups • Database restoration Estimated Recovery Times and Recovery Time Objectives are influenced by service tier selection • Active geo-replication is available on all tiers and provides up to 4 secondaries with read access • Manual failover from 1 of 4 readable secondaries in same or different region. Need to update connection strings to point to new primary • Other secondaries are auto-linked to new primary • Azure SQL DB Failover Groups (extension of geo- replication) • Systems can be in same or different regions • Readable secondaries • One failover secondary in a different region is used for automatic failover • Configure auto-failover polices that trigger activation • Configure one address that does not need to be updated during failover. Like a Windows Cluster Name…
  • 41.
    www.rdx.com 41 © 2018© 2018 THEREIS A LEARNING CURVE THAT VARIES ACCORDING TO VENDOR Don’t Expect Your Staff to Become Cloud DBMS Experts Overnight • Migration • Data Access • Data Transfer • High Availability • Backups • Restores • Performance Tuning • Troubleshooting • Costing • Storage • Compute • Provisioning • Administering • Security • Monitoring Tools • Admin Tools Greater Impact DBaaS Less Impact IaaS
  • 42.
    www.rdx.com 42 © 2018 1. Databaseimportance 2. Database usage (customer facing, LOB, back office) 3. Frequency of application development activity and schema changes 4. Database features utilized 5. Dependency and interaction with other systems • Flat file loads • Sends data to/receives data from other systems • Data used to refresh other systems • DB links used to access other databases 6. What level of modifications are you comfortable with? • Lift and shift • Limited changes • Changes to APIs, connection mechanisms • Total application rewrite to leverage new technologies 7. What on-premises software tools interact with DB? • Monitoring, application development, security 8. Performance requirements • Stable workloads or spikes/seasonal peaks? 9. Monitoring requirements 10. Security 11. Is data controlled by internal, industry-specific or governmental regulatory requirements? 12. What auditing requirements are you required to meet? 13. What is the database footprint and workloads? • Disk storage – How much data? • Concurrent users • CPU and memory consumption • I/O 14. High availability requirements 15. Backup requirements (frequency, # historical copies) 16. Disaster recovery requirements Selecting Databases For Migration
  • 43.
    www.rdx.com 43 © 2018 The moreinteraction the DB has with on-premises systems, the more complicated support becomes Flat File Loads Input from other DB Apps Large Output Files Sent to Other Systems Output to Other DB Apps Data Clones and Refreshes New Data Transfer Mechanisms New Data Transfer Procedures No Database is an Island
  • 44.
    www.rdx.com 44 © 2018 Where WillYour Apps Reside? Achieving acceptable response times for online transactions will be a challenge if your application programs are on-premises and your DB is in the cloud. You will need evaluate the type of application and its performance requirements before you migrate its database to the cloud. Robust performance test plans will be required.
  • 45.
    www.rdx.com 45 © 2018© 2018 •Acceptable Outage Length • On-Premises OS and DB Version • Converting to Different DB Product • Bandwidth • Data Volumes • Update Frequency • Database Complexity • DB Product Specific Features • Vendor Cloud Migration Utilities • Security Considerations When Selecting Migration Mechanisms Greater Impact DBaaS Less Impact IaaS
  • 46.
    www.rdx.com 46 © 2018 Amazon DatabaseMigration ServiceAmazon Schema Conversion Tool • SCT is free to use • Converts schema objects including tables, indexes, views, stored procedures, and functions • Scans application source code to identify and convert SQL statements • Compares database schemas • Use mapping rules to change data types, move and rename objects, add/replace/remove prefixes and suffixes for databases, schemas, tables and columns • Generates schema conversion reports listing objects that can not be converted • Generates SQL statement conversion reports listing code that can not be converted • Extension pack allows you to emulate on-premises DB functions (job scheduling, email using Lambda functions) • Amazon provides common conversions issue for each DB product • Pricing is per hour based on instance size • Target = Aurora Free for 6 months. 9 with extension • Creates only those schema objects required to successfully replicate data • Seeds data and then replicates changes • Able to monitor data transfer problems and performance issues • Can create an assessment report for migration tasks that could affect migration process • Can choose objects to be migrated • Can limit rows migrated (good for initial testing • Filter based on column values • Amazon provides several security features to protect data transfers • Able to activate data validation which is performed after each table is migrated (adds time to process) Amazon DBaaS Migration Tools
  • 47.
    www.rdx.com 47 © 2018© 2018 MicrosoftDBaaS Migration Utilities Data Migration Assistant • Downtime required • Identifies cloud compatibility issues • DMA can also perform the analysis and generate report on what is not compatible with Azure SQL Database (DBaaS) without executing migration • Migrates schema, data, users, server roles and logons Data Migration Service • Uses output generated by Data Migration Assistant • Azure Portal Service that converts databases from on-premises to cloud • Provides ongoing replication to synchronize on-premises and cloud databases • Source: currently supports SQL Server, Oracle and MySQL • Target: Azure SQL DB Transactional Replication • No downtime • Azure SQL Database becomes a subscriber to the SQL Server on-premises instance • Requires that a new snapshot be taken and applied • Database can be online but it may impact performance • Perform snapshot off-hours
  • 48.
    www.rdx.com 48 © 2018 Database MigrationSteps * Robust Test Plans Required! Verification Cutover SynchronizationInitial Evaluation Migrate Structure Planning
  • 49.
    www.rdx.com 49 © 2018© 2018 THEHARDER IT IS TO SWITCH VENDORS The More You Have to Tailor Your Database/Application to Work With Your Chosen Cloud Architecture
  • 50.
    www.rdx.com 50 © 2018© 2018 AREYOU READY FOR A CLOUD OUTAGE?
  • 51.
    www.rdx.com 51 © 2018© 2018 Selectthe Appropriate Database Driven Applications for the Cloud Have a Cloud Strategy: Migration/Testing/Ongoin g Support Plans Thoroughly Understand and Evaluate Competing Offerings Recognize That They Are Supported Differently than On-Premises Counterparts RDX Cloud DBMS Recommendations
  • 52.
    www.rdx.com 52 © 2018 RDX’s Goalis to Become the Cloud Advisor Our Customers Can’t Do Without What We Learn From Our Customers You may not want to do that… • Support best practices • Security procedures • Best architecture implementations • Product selection, implementation and usage • What products work together • Software combinations (best Tech Stack) • Recurring issues • Problem prevention Benefits All Customers
  • 53.
    November Presentation Microsoft PowerBI Overview and Demo – Thursday, December 6th The RDX Report Top 10 DBaaS Migration Mistakes, RightScale Cloud Comparison Tool, Rise of Open Source Cloud Databases LinkedIn Will You Be Replaced by a Robot?, Selecting Cloud DBMS, NoSQL Architectures, Database Security Series, Improving Customer Service 20YEARS OF SERVICE DELIVERY EXPERIENCE cfoot@rdx.com