1. The document outlines a presentation on data warehouse automation given by Jos Driessen. It discusses challenges with current ETL architectures and surveys attendees on their current and preferred approaches. 2. The presentation proposes moving to an ELT and data vault architecture using the WhereScape tool to automate processes. This would allow for faster development cycles and deployments with more work done onshore. 3. Key takeaways include leveraging the database for logic and ELT, adopting data vault 2.0 practices, and using a tool like WhereScape for automation to enable an agile data warehouse and integration with big data.

1. 1
3 November 2016 10:30am - 11:00am
Data Warehouse Automation:
Solve integration challenges, speed up
time to market and save costs
Change to an agile
Data Warehouse
and Big Data
will come to you
Big Data LDN

2. 2
Jos Driessen - a short introduction
34 Years consultant
2,5 years Vodafone NL
Just started BI demystified

3. Agenda
1. Survey : What
are you using?
2. Architecture
- keep your
balance
3. WhereScape
4. Strategy
- restore your
balance
5. Survey: What
would you
like to use?
6. Take away slide

4. Survey now
A. ETL and 3NF
B. ETL and DV
C. ELT and 3NF
D. ELT and DV
E. I don’t care
2. Survey
What are you using now
in your DWH?

5. 5
Survey results Hamburg now
2. Survey – Results Hamburg
0 10 20 30 40 50
E. I don't care
D. ELT and DV
C. ELT and 3NF
B. ETL and DV
A. ETL and 3NF
%

6. 6
3. Architecture

7. 7
Architecture - keep your balance
• Reports on T-2
• No Big data analyticsProjects : Waterfall
Duration: months
• Ab Initio (ETL to 3NF)
• Composite: light weight ELT
• Teradata scripts (3NF to DM)
• Reporting: SAP BO, Tableau
Vodafone Ratingen
HP Unix / Linux
Teradata, Aster, Hadoop
3. Architecture - keep your balance
Development:
Offshore 80%
Deployment:
Offshore L1, L2, L3

8. 8
8
WhereScape
4. WhereScape

9. 9
4A. WhereScape | Wiki
RED
• Templates and wizards to automate BI
development and deployment.
• Concepts: 3NF, DV, DM.
• Optimized on Teradata
with very small footprint.
• Pure ELT Solution
• Metadata driven
3D
• Discover, explore, and document
potential source systems
• Source data profiling
• Enables automated model conversion!
• DV 2.0 Support
• Generates RED Metadata

10. 10
4B. WhereScape| Way of Working
Current way of working Alternative way of working
Hybrid approach – Best of both worlds

11. 11
Deploy
Manage,
Operate
Map
EDWIM
Prototype Information Mart
4C. WhereScape | Practice
Model
Source
Refine
Review
Model EDW
Generate
EDW
Generate
Load &
Stage

12. 12
Strategy5. Strategy

13. 13
Strategy restore your balance
Development:
Initiatives
Agile / fail fast
Onshore 100%
Deployment:
Offshore: L1, L2
Onshore: L3
5. Strategy - restore your balance
Faster time to market
Partly T-1
DWH documentation
Hackathon
Big data in Hadoop
and in DWH
Change culture
Train Developers
Train L1, L2, L3
Need more Teradata space
• Less Ab Initio (ETL to 3NF)
• Less Composite
• Less Teradata scripts
(3NF to DM)
• Use WhereScape
(ELT to DV to DM)
• Fix : 3NF/ DV integration
• Hadoop, Aster (App center)

14. 14
Survey results
A. ETL and 3NF
B. ETL and DV
C. ELT and 3NF
D. ELT and DV
E. I don’t care
6. Survey
What would you like
to use in your DWH?

15. 15
Survey results Hamburg Like
6. Survey – Results Hamburg
% 0 10 20 30 40 50
E. I don't care
D. ELT and DV
C. ELT and 3NF
B. ETL and DV
A. ETL and 3NF

16. 16
Take away slide
Leverage the power of your DBMS
• Push all logic into your DBMS
• Use ELT
Leverage the power of Data Vault 2.0
• New initiatives in Data Vault 2.0
• Integrate DV with your current DWH
Leverage the power of DWH Automation
• Select a tool (WhereScape)
• Hybrid development approach
Source Business
7. Take Away slide
Change to an agile Data Warehouse
and Big Data will come to you

17. 17
Jos.Driessen@BIdemystified.com
3 November 2016 10:30am - 11:00am
Data Warehouse Automation:
Solve integration challenges, speed up
time to market and save costs
Big Data LDN