Data Vault 2.0 DeMystified with Dan Linstedt and WhereScape
•Download as PPTX, PDF•
2 likes•706 views
Join Dan Linstedt and WhereScape to learn the benefits that Data Vault 2.0 offers to data warehousing teams, what it is and isn't, and how data vault automation can help teams implement Data Vault 2.0 more quickly and successfully.
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Data Vault 2.0 DeMystified with Dan Linstedt and WhereScape
Similar to Data Vault 2.0 DeMystified with Dan Linstedt and WhereScape (20)
Recently uploaded
Recently uploaded (20)
Data Vault 2.0 DeMystified with Dan Linstedt and WhereScape
- 1. Data Vault 2.0 Demystified Dan Linstedt, Data Vault 2.0 Inventor
- 2. Introducing Dan Linstedt Data Vault 2.0 Inventor DataVaultAlliance.com
- 3. Data Vault 2.0 Demystified
- 4. Why Data Vault? • Inconsistent and missing standards • Constant re-engineering to fit big data • Large production bug lists • Late delivery • Non-sharable team resources • Non-standardized ways-of-working • Rigid legacy data mart silos • Unreconcilable answers • Poor security for private info People Process Technology
- 5. What is Data Vault 2.0? What is Data Vault? A System of Business Intelligence containing the necessary components needed to accomplish enterprise vision in Data Warehousing and Information Delivery. Foundational Pillars of Data Vault 2.0 Far more than just a data modeling technique, it is a complete methodology.
- 6. Benefits of Data Vault 2.0 Multi-Team Agility 360 Enterprise Vision Gap Analysis of Business Effectiveness Cross Program Collaboration Accuracy / Auditability with General Ledger Adaptation To Change without Re-Engineering! Automation / Generation Big Data & NoSQL Compatibility
- 7. More Benefits of Data Vault 2.0 •SOX, GDPR, BASIL, HIPPA Meet Compliance •Terabytes to Petabytes Scale Easily •Tackle Master Data Management Consolidate Fully •Rapid ROI with Agile Teams Produce Quickly •SEI CMMI Level 5 Achieve Simply
- 8. More Benefits of Data Vault 2.0 •SOX, GDPR, BASIL, HIPPA Meet Compliance •Terabytes to Petabytes Scale Easily •Tackle Master Data Management Consolidate Fully •Rapid ROI with Agile Teams Produce Quickly •SEI CMMI Level 5 Achieve SimplyAXA Global Insurance – GDPR regulations world-wide with PII, Data Vault, and cell level security
- 9. More Benefits of Data Vault 2.0 •SOX, GDPR, BASIL, HIPPA Meet Compliance •Terabytes to Petabytes Scale Easily •Tackle Master Data Management Consolidate Fully •Rapid ROI with Agile Teams Produce Quickly •SEI CMMI Level 5 Achieve Simply Micron: 3.2 trillion records per day, streaming from 10 worldwide manufacturing facilities, sub second query response times across billions of rows
- 10. More Benefits of Data Vault 2.0 •SOX, GDPR, BASIL, HIPPA Meet Compliance •Terabytes to Petabytes Scale Easily •Tackle Master Data Management Consolidate Fully •Rapid ROI with Agile Teams Produce Quickly •SEI CMMI Level 5 Achieve Simply Department of Defense: Insider threat and identity resolution using business key attribution and identification
- 11. More Benefits of Data Vault 2.0 •SOX, GDPR, BASIL, HIPPA Meet Compliance •Terabytes to Petabytes Scale Easily •Tackle Master Data Management Consolidate Fully •Rapid ROI with Agile Teams Produce Quickly •SEI CMMI Level 5 Achieve Simply NetJets: Reduced turn-around time from 4 weeks to 2 days, completing productionalization with near zero defects
- 12. More Benefits of Data Vault 2.0 •SOX, GDPR, BASIL, HIPPA Meet Compliance •Terabytes to Petabytes Scale Easily •Tackle Master Data Management Consolidate Fully •Rapid ROI with Agile Teams Produce Quickly •SEI CMMI Level 5 Achieve Simply QSuper (Aus): Reached CMMI Level 5 repeatability and optimization 7 weeks after leveraging Data Vault 2.0 methodology
- 13. DV2 : Proven Solution Backed by… 10 years of R&D, 30k test cases 15+ years of successful delivery SEI / CMMI, disciplined agile delivery Six Sigma, TQM 6000+ world-wide practitioners Successful implementations across: Banking, Insurance, Telco, Governments, Healthcare, Manufacturing, Retail and more
- 14. What it Takes to Execute Successfully Automation Standards & Rigor Desire to ‘do things differently’ Training Collaboration
- 15. How Can Data Vault Automation Help?
- 16. With Data Vault Automation Development is Simplified and Automated Metadata-driven Built-in Data Vault 2.0 methodology Best practices, industry standards Documentation and lineage Full lifecycle management
- 17. Scenario • From SQL Server to Snowflake, using WhereScape® automation and Data Vault 2.0 Results • Created first data vault design in WhereScape within 3 days • First production data vault within Snowflake in 3 months, fully documented
- 18. Implemented the foundation for the global enterprise data warehouse within 90 days Delivered new data warehouse prototypes in less than 1 hour Improved speed, quality, consistency, and transparency of data warehouse solutions Saved costs by decommissioning ETL solution Accelerated time-to-production from 6 months to 2 days Reduced load time for data by 90% Challenge Solution Challenge Solution Deliver new projects and changes much faster, while reducing operating costs Data Vault WhereScape Teradata Accelerate access to manufacturing data Data Vault 2.0 WhereScape Teradata
- 19. WhereScape® Data Vault Express™ Designed for Data Vault 2.0 • Automatically generates hubs, satellites and links • Automatically generates hash and change keys • Automatically manages DV metadata attributes • Automatically generates all code to instantiate and populate the data vault
- 20. Cut the complexity Automate to Make Data Vaults a Practical Reality Shorten Data Vault 2.0 learning curve with built-in automation, wizards, patterns models Automate for speed Deliver data vault-based solutions in hours and days rather than months and years Reduce project risk Shrink schedules and increase the success of the data vault methodology
- 21. Questions? Dan Linstedt dan.linstedt@gmail.com www.learndatavault.com Twitter: @dlinstedt Armon Petrossian armon.petrossian@wherescape.com www.wherescape.com
- 23. Thank You
- 24. WhereScape.com © Copyright 2018, WhereScape Software Ltd. All rights reserved. All trademarks, trade names, service marks and logos referenced herein belong to their respective companies. About WhereScape WhereScape helps IT organizations of all sizes leverage automation to design, develop, deploy and operate data infrastructure faster. More than 700 customers worldwide rely on WhereScape automation to eliminate hand-coding and other repetitive tasks to deliver data warehouses, vaults, lakes and marts in days or weeks rather than months or years. WhereScape has global operations in the USA, UK, Singapore and New Zealand.
Editor's Notes
- Join WhereScape and Dan Linstedt, inventor of Data Vault 2.0, at DISTRICT restaurant on Tuesday, April 16, 2019 for Data Vault 2.0 Demystified. During this private reception, you’ll meet Dan and learn why many see Data Vault as the trend of the future for Data Warehousing. Whether you’re curious to learn more about the benefits of Data Vault 2.0, or you’re already using Data Vault 2.0 within your organization, do not miss this opportunity to meet and hear from Dan firsthand. During the evening, you’ll hear how Data Vault 2.0 can help your team: Manage and enforce compliance to Sarbanes-Oxley, HIPPA, and BASIL II in your Enterprise Data Warehouse Spot business problems that were never visible previously Rapidly reduce business cycle time for implementing changes Merge new business units into the organization rapidly Achieve rapid ROI and delivery of information to new Star Schemas Consolidate disparate data stores, tackling Master Data Management Implement and deploy Service-Oriented Architecture fast Scale efficiently to hundreds of Terabytes or Petabytes Reach SEI CMM Level 5 compliance (repeatable, consistent, redundant architecture) More easily trace all of your data back to the source system You’ll also hear how data vault automation is helping organizations begin to reap the benefits of Data Vault 2.0 more quickly and make its adoption a practical reality.
- Bios: Our Speakers: Dan Linstedt, inventor of the Data Vault Architecture (now deemed Data Vault 1.0) and Data Vault 2.0, is a world-renowned expert in Data Warehousing and Business Intelligence with over 25 years of IT experience. He has helped many organizations, including Fortune 50 companies like Nike, the US Air Force, US Department of Defense, American Automobile Association, Desjardins Bank, Edmonton Police Services and successfully implement Business Intelligence solutions. Dan is also the author of The New Business Supermodel and the de-facto standard for Data Vault 1.0 Modeling – Super Charge Your Data Warehouse. Dan offers private Data Vault 2.0 certifications and has co-founded LearnDataVault.com to help spread the word and education about the Data Vault and share his real-world experiences.
- Do you think we need a slide like this? That illustrates just what a DV2 is?
- Manage and enforce compliance to SOX, GDPR, HIPPA and BASIL in your Enterprise Data Warehouse Achieve rapid ROI and delivery of information to business Consolidate disparate data stores, tackling Master Data Management Scale efficiently to hundreds of Terabytes or Petabytes Reach SEI CMM Level 5 compliance (repeatable, consistent, redundant architecture)
- Manage and enforce compliance to SOX, GDPR, HIPPA and BASIL in your Enterprise Data Warehouse Achieve rapid ROI and delivery of information to business Consolidate disparate data stores, tackling Master Data Management Scale efficiently to hundreds of Terabytes or Petabytes Reach SEI CMM Level 5 compliance (repeatable, consistent, redundant architecture)
- Manage and enforce compliance to SOX, GDPR, HIPPA and BASIL in your Enterprise Data Warehouse Achieve rapid ROI and delivery of information to business Consolidate disparate data stores, tackling Master Data Management Scale efficiently to hundreds of Terabytes or Petabytes Reach SEI CMM Level 5 compliance (repeatable, consistent, redundant architecture)
- Manage and enforce compliance to SOX, GDPR, HIPPA and BASIL in your Enterprise Data Warehouse Achieve rapid ROI and delivery of information to business Consolidate disparate data stores, tackling Master Data Management Scale efficiently to hundreds of Terabytes or Petabytes Reach SEI CMM Level 5 compliance (repeatable, consistent, redundant architecture)
- Manage and enforce compliance to SOX, GDPR, HIPPA and BASIL in your Enterprise Data Warehouse Achieve rapid ROI and delivery of information to business Consolidate disparate data stores, tackling Master Data Management Scale efficiently to hundreds of Terabytes or Petabytes Reach SEI CMM Level 5 compliance (repeatable, consistent, redundant architecture)
- Manage and enforce compliance to SOX, GDPR, HIPPA and BASIL in your Enterprise Data Warehouse Achieve rapid ROI and delivery of information to business Consolidate disparate data stores, tackling Master Data Management Scale efficiently to hundreds of Terabytes or Petabytes Reach SEI CMM Level 5 compliance (repeatable, consistent, redundant architecture)
- What is a checklist of 3-5 major items to teams should ensure they have within their grasp – cultural mindset, staffing needs, plan of attack, and lastly including “data vault automation” as an aspect that teams should consider implementing to increase success – see next slide for different layout idea
- Data infrastructure automation when applied to more traditional platforms and data sources has helped IT teams to reduce the data warehouse lifecycle by 80% and boost developer productivity 5x compared to when using previous, manual methods for data infrastructure design, development, deployment and operation. As a result, organizations have seen faster time-to-value for their investments, and have successfully delivered data infrastructure projects with less resourcing (or costs) in less time and with greater consistency and quality. All translating into less new project risk, and longer term maintainability as resources change and infrastructure needs evolve. IT teams are using automation to increase their ability to keep pace with their organizational needs.
- Notes about Aptus Health Scenario A decade of organic and acquisition-related growth yielded sets of data silos and legacy data warehouse integration challenges Negative Consequences No centralized data availability No master data management No historical data or ability to report on trends Virtually no documentation After Replace 12-yr old on-premises SQL Server data warehouse environment with Snowflake and use WhereScape automation to fast-track the project and minimize cost Approach Adopt Data Vault 2.0 modeling method to create new cloud-based data warehouse more resilient to business and technology change Quick Wins Created first data vault design in WhereScape® Data Vault Express™ for Snowflake in 3 days Through automation, delivered first production release of Snowflake data vault in 3 months Lasting Results Central availability of data, no more discrepancies Can answer business questions, i.e. historical trends US and International data extensibility – logically integrated, physically separate Now delivers data in minutes, not days Fully documented data warehouse
- ACCELERATES TIME TO PRODUCTION CUTS THE COMPLEXITY Reduces the complexity of building and updating compliant Data Vaults REDUCES COST, EFFORT AND RISK Data Vault 2.0 patterns and best practices are built in, with wizards & templates for ease of use, consistency, and speed