Downloaded 14 times
Uploaded byKellyn Pot'Vin-Gorman
Agile DBA
The document discusses how virtualizing databases can help database administrators (DBAs) by eliminating repetitive tasks, speeding up development and testing, and saving on storage costs. Virtualizing environments allows quicker access for development sprints and avoids having to repeatedly perform maintenance tasks like patching and upgrading on each database. It also simplifies moving databases to the cloud. Masking data when virtualizing helps address legal requirements for protecting sensitive information. The overall message is that virtualizing is key for DBAs practicing DevOps and the quickest way to complete a task is to avoid having to do it repeatedly through virtualization.
More Related Content
More from Kellyn Pot'Vin-Gorman
Agile DBA
- 1. Agile Database AdministrationWithout Limits Knowledge is Power Kellyn Pot’Vin-Gorman | Technical Intelligence Manager
- 2. 2© 2016 DelphixCorporation Kellyn Pot’Vin-Gorman Technical Intelligence Manager, Delphix • Multi-platform DBA, (Oracle, MSSQL, MySQL, Sybase, Postgres…..) • Oracle ACE Director, (Alumni) • Oak Table Network • APEX Women in Technology Award, CTA 2014 • STEM education with Raspberry Pi and Python • Board of Director, RMOUG • Rocky Mountain Oracle Training Days Conference Director • Author, blogger, (http://dbakevlar.com)
- 3. 3© 2016 DelphixCorporation The Quickest Task is One You Never Have to Do.
- 4. 4© 2016 DelphixCorporation The New Frontier of Database Administration • Demands to do more with less resources • Now you need the cloud, too. • DBA is stretched to know more areas of technology- storage, performance, coding, test data management • Agile • DevOps • Now you need to know virtualization, too!
- 5. 5© 2016 DelphixCorporation Virtualization Adoption Trend . Source: Gartner Forecasts
- 6. 6© 2016 DelphixCorporation This will only increase in the next five years as cloud overtakes the industry
- 7. 7© 2016 DelphixCorporation Source: Right Scale State of the Cloud 2016 Cloud Adoption
- 8. 8© 2016 DelphixCorporation Hardware - VM level, not application or software “aware”. - Older VM technology required the virtual image to be in a static or closed state before creating a snapshot. - Some hardware VM technology is software “aware” or compliant. Software Consistent - Creates a static or consistent snapshot of software or applications. - Similar to RMAN putting tablespaces in backup mode, tracks changes and block level for both physical and logical consistency. - Is required for complex code and interactive products. Types of Snapshots
- 9. 9© 2016 DelphixCorporation How Snapshots Work
- 10. 10© 2016 DelphixCorporation An overall trend in companies that includes autonomic computing, where the IT environment will be able to manage itself based on perceived activity, and resource shared computing, in which computer processing power is utilized and/or paid for only as needed. The usual goal of virtualization is to centralize administrative tasks while improving scalability and work loads. The Future of Virtualization
- 11. 11© 2016 DelphixCorporation Using standard cloning or backup/recovery methods. Standard Database Environment Finance HR CRM
- 12. 12© 2016 DelphixCorporation
- 13. 13© 2016 DelphixCorporation Patching and Upgrading Databases Each patch, (PSU) would need to be applied to a development database, requiring outage to development teams and then tested before applying to test, QA and then onto production. This has to be performed to EACH environment, every database, each quarter. Finance HR CRM
- 14. 14© 2016 DelphixCorporation • Downtime for valuable resources. • DBAs working afterhours • Each database must have it done and… - The tedious task must be performed over and over again. - Little opportunity for advanced learning. - Each database may experience different bugs. Risks/Challenges Of This Approach
- 15. 15© 2016 DelphixCorporation ▶▶▶ Virtualize and Deployed▶ ▶ ▶ 0.6 TB Virtualization Eliminates 90%+ Common, Repeated Data Storage Pool for Delphix QA DEV PATCH TEST PRODUCTION Database/App Tier 1 TB 1 TB Read From Production Spin a VIRTUAL database up a patch test, without having to remove a current development or test one. TEST
- 16. 16© 2016 DelphixCorporation Spin up a new VDB and apply patch there- no need to commandeer existing! Environment Virtualization, DB Style
- 17. 17© 2016 DelphixCorporation No need to keep the extra VDBs post patch to prod. After Testing, Apply to Production
- 18. 18© 2016 DelphixCorporation The Compressed Copies in the Delphix Engine are Upgraded! Environment Virtualization, DB Style
- 19. 19© 2016 DelphixCorporation In minutes, refresh and complete! Environment Virtualization, DB Style
- 20. 20© 2016 DelphixCorporation
- 21. 21© 2016 DelphixCorporation
- 22. 22© 2016 DelphixCorporation • Manage Databases and Applications • Need environments, but may not care about anything at the storage or network level. • Need a user friendly interface. The DBA, The Developer and The Tester Need to…
- 23. 23© 2016 DelphixCorporation Environments Snapshot Previous Snapshots Virtual to Physical Timeflow Slider Actions
- 24. 24© 2016 DelphixCorporation What is Copy Data Management?
- 25. 25© 2016 DelphixCorporation Could be Simple, FULL Copies…
- 26. 26© 2016 DelphixCorporation What if they’re in the Cloud?
- 27. 27© 2016 DelphixCorporation Why Hybrid Management with Virtualization Compressed and de-duped
- 28. 28© 2016 DelphixCorporation Which Would You Rather Manage/Pay For?
- 29. 29© 2016 DelphixCorporation Ability to Deliver and Mask Data for Testing- FAST DB AP P DB APP DB APP DB APP DB APP DB Mask PCI/PII and then virtualize Develop Test Deploy
- 30. 30© 2016 DelphixCorporation Do I Legally Have to Protect Data? Type of Data Year Passed Ruling Data Masking in the EU 2014 ARTICLE 29 DATA PROTECTION HIPAA 1996 Health Insurance Portability and Accountability Act PCI 2016, (Updated) Payment Card Industry Standards PII Personably Identifiable Information SOX 2002 Sarbanes-Oxley Act
- 31. 31© 2016 DelphixCorporation As 80% of data in a company are copies, then 80% of data won’t be subject to security like a production environment. Securing this data is not just a priority, but in many cases, subject to legal ramifications, (i.e. PCI/PII) Masking Requirements Masking shouldn’t be reversible The masked data should be representative of the original data type to ensure performance is consistent. Referential Integrity should be maintained as part of the masking process. Masking should be a simple, repeatable process with a user interface that ensures it is simple. Masking in the Picture
- 32. 32© 2016 DelphixCorporation Summary • Virtualizing environments allow for quicker access for development and test sprints. • Virtualizing can eliminate a ton of work from maintenance windows like patching and upgrading. • Virtualizing can save on storage and make the move to the cloud simpler. • Virtualizing is the key to DevOps for any DBA.
- 33. 33© 2016 DelphixCorporation The quickest way to complete a task is not having to do it.
- 34. 34© 2016 DelphixCorporation @DBAKevlar https://dbakevlar.com http://delphix.com kellyn@delphix.com https://linkedin.com/in/kellynpotvin Connect With Me
- 35. 35© 2016 DelphixCorporation Q&A Thank you!
Editor's Notes
- #10 One image, many copies, only the header is required to create an backup or restore.
- #12 DBA has to commandeer a database for patch testing. This has to be performed for EACH environment, 100’s or 1000’s of databases! Most are not synchronized with production, different outcomes when released to production. Bugs occurring in one, not another!
- #19 Testing upgrades and patches can be greatly simplified using the portability and ease-of-use of Delphix Virtual Databases (VDBs). Here are two approaches that can be used, depending on the upgrade or patch. Link the production database with the Delphix Server. Provision a VDB at the existing patch level. Patch the existing $Oracle_Home against the live VDB. or Create the new $Oracle_Home and swing the VDB. Rollback VDB or Refresh from production. Repeat 3 or 4 until confident. Once the process has been tested and confirmed, it can be rolled out with confidence into production.
- #24 This is less overwhelming than the last image…show how easy it is to manage and work with Delphix, (specifying a virtualizing product)
- #25 Go through how copies can be made, but not virtualized Go through then how a cli without a UI, can make it difficult to manage all those clones and that’s not CDM and may have nothing again, to do with virtualized, takes up space, which Is what cloud loves.
- #26 Go through how copies can be made, but not virtualized Go through then how a cli without a UI, can make it difficult to manage all those clones and that’s not CDM and may have nothing again, to do with virtualized, takes up space, which Is what cloud loves.
- #27 Go through how copies can be made, but not virtualized Go through then how a cli without a UI, can make it difficult to manage all those clones and that’s not CDM and may have nothing again, to do with virtualized, takes up space, which Is what cloud loves.
- #28 Go through how copies can be made, but not virtualized Go through then how a cli without a UI, can make it difficult to manage all those clones and that’s not CDM and may have nothing again, to do with virtualized, takes up space, which Is what cloud loves.
- #31 Article 29 makes it unlawful in EMEA to not just encrypt, but to mask data in non production systems and when handling data outside of secure environments. HIPAA protects medical information PCI protects payment information, via the internet, inside companies and in the public eye. PII protects personably identify information between systems, (big brother) for demographics and information collections SOX protects investor information
- #32 If the ssn is the reference key, then the numbers should be masked identically across the objects to ensure integrity is maintained.