Successfully reported this slideshow.

#Centennium Presentation Data Vault Automation seminar #dvauto Oct 6th 2011

1,719 views

Published on

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

#Centennium Presentation Data Vault Automation seminar #dvauto Oct 6th 2011

  1. 1. CDM<br />Centennium Datawarehouse Methodology<br />Structure – Model – Generate – Knowledge Partnership<br />1<br />Erik Fransen<br />Antoine Stelma<br />October 6, 2011<br />
  2. 2. Agenda<br />2<br />Centennium BI expertisehuis<br />CDM<br />Structure Reference Architecture<br />Model Data Vault<br />Generate Template Based Development<br />Knowledge Partnership Knowledge transfer, coaching<br />CDM process<br />
  3. 3. Centennium BI expertisehuis<br />Independent <br />We provide our customers with the right skills, at the right time and the right way<br />Consultancy, ad-interim support, project implementation and training services, but primarily acts as a BI/DWH knowledge partner for its clients<br />We take or share responsibility for the execution and management of BI and DWH projects and provide second or third line support for existing implementations<br />We offer an extensive portfolio of courses and training services <br />We provide our customers with the knowledge and practical insights required to be(come) self-sufficient in maintaining and expanding their BI-environments<br />www.centennium.nl<br />3<br />
  4. 4. Centennium Datawarehouse Methodology<br />A methodology, including DWH-tools<br />Build or migrate datawarehouses fast, with high qualityand low cost<br />Automatic generation of datawarehouse based on descriptivemetadata<br />CDM includes:<br />Template Based Development<br />Best practices<br />Quality control mechanism<br />Knowledge partnership<br />Best Practices: Data Vault, Kimball, Reference Architecture<br />Qualitycontrol mechanism: extensive checklists anddocumentation<br />Knowledge transfer by training, certificationandlearning on-the-job<br />4<br />
  5. 5. 5<br />Centennium Datawarehouse Methodology<br />Knowledge Partnership<br />Modelling<br />Structuring<br />Generating<br />
  6. 6. Knowledge partnership<br />Goal: Self-supporting, CDM-awarecustomers<br />Training options <br />BI and DWH fundamentals<br />CDM designer / TBD developer training <br />Data Vaultfundamentals<br />Data Vaultcertification(Genesee Academy) <br />Dimensionalmodelling<br />More info on www.bi-opleidingen.nl<br />On-the-job coaching, learningbydoing<br />Centennium supports it’scustomersby(management) consultancy, assessments, projects, training andsourcing<br />6<br />
  7. 7. Reference Architecture: Structuring<br />7<br />
  8. 8. Template Based Development:Generating<br />TBD generatesall ETL and objects for<br />Registrationlayer<br />Presentation/Publicationlayer<br />Repositoryand scripts are free of charge<br />Creating the staginglayer is not part of TBD but canbeautomated per customer<br />8<br />
  9. 9. TBD databases<br />9<br />Repository (REP)<br />Central Data Warehouse (CDW)<br />Staging (STA)<br />Publication (PUB)<br />
  10. 10. TBD repository<br />10<br />Repository (REP)<br />Central Data Warehouse (CDW)<br />Staging (STA)<br />Publication (PUB)<br />
  11. 11. Functionality TBD repositorylogtables (1)<br />Functionality: <br />Registration of all ETL processes<br />Insight in data logistics<br />Historic profile of loadingprocesses<br />Goal:<br />Traceability<br />Maintenance: localisationandidentification of all data/transactions (wrong andcorrect)<br />Linkage to source systems<br />11<br />REP<br />PUB<br />STA<br />CDW<br />
  12. 12. Functionality TBD repositorytemplate tables<br />Functionality: <br />Central storage of template scripts forgeneratingtablesand ETL procedures<br />Easy promotion to other environments (OTAP)<br />Transparant<br />Goal: <br />Version management of templates<br />Object (re-)creationand maintenance<br />12<br />REP<br />PUB<br />STA<br />CDW<br />
  13. 13. Functionality TBD repositorymeta data tables<br />Functionality: <br />Definesregistrationandpublicationlayer<br />Contains object and ETL definitions<br />Contains data logistics<br />Goal:<br />Generating:<br />Registrationlayer(Data Vaulttables)<br />Publicationlayer (Star schemes) <br />ETL processes via ‘stored procedures’<br />Object creationand maintenance<br />13<br />REP<br />PUB<br />STA<br />CDW<br />
  14. 14. Functionality TBD repositorymeta data tables<br />Table ‘Repos_Table’: <br />Contains object namesfor<br />Staging<br />Registration<br />Publication<br />Table is filledbyanapplication or Excel sheet<br />Table ‘Repos_Mapping’: <br />Contains mapping of staging, registration and presentation<br />Table is filledbyanapplication or Excel sheet<br />14<br />REP<br />PUB<br />STA<br />CDW<br />
  15. 15. Registrationlayer<br />15<br />Repository (REP)<br />Central Data Warehouse (CDW)<br />Staging (STA)<br />Publication (PUB)<br />
  16. 16. Registrationlayer<br />Script ‘CDW 01a table hub’<br />Generatesall hub tables in the CDW, as defined in repository<br />Every hub contains the columns: <br />id (primarykey), <afkorting>_key, meta_laad_dts, meta_bron en meta_audit_id<br />Variables fromrepository are applied<br />Once the hubs are generated, the repository is updated<br />Hubs generated according to Data Vault Standards!<br />16<br />REP<br />PUB<br />STA<br />CDW<br />
  17. 17. Registrationlayer<br />Script ‘CDW 01a tabel hub’<br />Generatesall hub tables in the CDW, as defined in repository<br />Every hub contains the columns: <br />id (primarykey), <afkorting>_key, meta_laad_dts, meta_bron en meta_audit_id<br />Variables fromrepository are applied<br />Once the hubs are generated, the repository is updated<br />Hubs generated according to Data Vault Standards!<br />17<br />REP<br />PUB<br />STA<br />CDW<br />
  18. 18. Registrationlayer<br />Script ‘CDW 02a table sat’<br />Generatesallsatellitetables in the CDW, as defined in repository<br />Everysatellitecontains the the columns: <br />h_id (foreignkey), meta_laad_dts, meta_laad_eind_dts, meta_bron en meta_audit_id<br />Variables fromrepository are applied<br />Once the hubs are generated, the repository is updated<br />Satsgenerated according to Data Vault Standards!<br />18<br />REP<br />PUB<br />STA<br />CDW<br />
  19. 19. Registrationlayer<br />Script ‘CDW 02a tabel sat’<br />Generatesallsatellitetables in the CDW, as defined in repository<br />Everysatellitecontains the the columns: <br />h_id (foreignkey), meta_laad_dts, meta_laad_eind_dts, meta_bron en meta_audit_id<br />Variables fromrepository are applied<br />Once the hubs are generated, the repository is updated<br />Satsgenerated according to Data Vault Standards!<br />19<br />REP<br />PUB<br />STA<br />CDW<br />
  20. 20. Registrationlayer<br />Script‘CDW 03a table link’<br />Generatesalllink tables in the CDW, as defined in repository<br />Everylink is connected to two or more hubs<br />Variables fromrepository are applied<br />Once the links are generated, the repository is updated<br />Links generated according to Data Vault Standards!<br />20<br />REP<br />PUB<br />STA<br />CDW<br />
  21. 21. Registrationlayer<br />Script‘CDW 03a table link’<br />Generatesalllink tables in the CDW, as defined in repository<br />Everylink is connected to two or more hubs<br />Variables fromrepository are applied<br />Once the links are generated, the repository is updated<br />Links generated according to Data Vault Standards!<br />21<br />REP<br />PUB<br />STA<br />CDW<br />
  22. 22. Registrationlayer<br />Script‘CDW 04a table link satellite’<br />Generatesalllink satellitetables in the CDW, as defined in repository<br />Variables fromrepository are applied<br />Once the link satellites are generated, the repository is updated<br />Link satellites are generated according to Data Vault Standards!<br />22<br />REP<br />PUB<br />STA<br />CDW<br />
  23. 23. Registrationlayer<br />Script‘CDW 04a table link satellite’<br />Generatesalllink satellitetables in the CDW, as defined in repository<br />Variables fromrepository are applied<br />Once the link satellites are generated, the repository is updated<br />Link satellites are generated according to Data Vault Standards!<br />23<br />REP<br />PUB<br />STA<br />CDW<br />
  24. 24. Publicationlayer<br />24<br />Repository (REP)<br />Central Data Warehouse (CDW)<br />Staging (STA)<br />Publication (PUB)<br />
  25. 25. Publicationlayerdimensionsandfacts<br />Fedonlyanddirectlyfrom CDW<br />Conforms to Kimball’sstar scheme standards<br />Or anyother format <br />Business rulescanbeapplied<br />Currentlyusing views<br />Business rule editor in next release<br />Type SCD I, II, etc.<br />Conformeddimensionswhenneeded<br />25<br />REP<br />PUB<br />STA<br />CDW<br />
  26. 26. CDM: process<br />Incremental approach<br />Timeboxes of 4-6 weeks<br />26<br />
  27. 27. CDM: typical increment<br />90% Centennium 30% Customer<br />70% Customer40% Centennium<br />100% Customer10% Centennium<br />100% Centennium<br />Phase 1<br />Phase 2<br />Phase 3<br />Phase 4<br />Increment<br />31-12-2011<br />1-8-2011<br />Supporting customer<br />Training and Coaching on-the-job<br />CDM-training<br />Data Vault Certification<br /><ul><li>Typical increment ranges from 2 to 6 months
  28. 28. Centennium role changes from LEAD to FOLLOW
  29. 29. Customer is fully CDM-aware at the end of the increment
  30. 30. Centennium continuessupportingcustomersthroughknowledge partnership</li></li></ul><li>Q & A<br />28<br />
  31. 31. About centennium<br />29<br />
  32. 32. Centennium BI expertisehuis houses all the experts under one roof, hereby offering all knowledge and expertise to address the complex business intelligence issues facing our clients today<br />Facts and figures:<br /><ul><li>Founded: 1998
  33. 33. 45+ business intelligence consultants</li></ul>Core values:<br /><ul><li>Human Capital
  34. 34. In close collaboration
  35. 35. Objective and Independent</li></ul>Expertise:<br /><ul><li>Business intelligence
  36. 36. Strategic, tactic and operational
  37. 37. Vision based on “effective BI”</li></ul>Services overview:<br /><ul><li>Consultancy
  38. 38. Projects
  39. 39. Resourcing
  40. 40. Education</li></ul>Some of our clients: Woonbron, Albron, NZa, CAK, OBR, Vopak, several Dutch Municipalities, Aegon, Nutreco, TNO,Genzyme, Tata Steel, KPN, DELTA, IKEA, Accell, TomTom, KAS BANK, LeasePlan, Brabant Water<br />
  41. 41. Certification and Industry Recognition<br />All Centennium consultants are Certified BI Professionals (CBIP) awarded by TDWI. <br />CBIP, backed by TDWI's reputation as the leader in BI education and research, makes a strong statement that we are among the leaders in the industry—up to date with BI technologies, knowledgeable about best practices and state-of-the-art solutions, and informed of emerging trends<br />All Centennium Data Vault specialists and architects are certified on Data Vault modeling by Dan Linstedt, Data Warehouse industry thought leader and founder of the Data Vault modeling standard.<br />Centennium is the business partner of Genesee Academy in organizing the Data Vault Modeling & Certification – Europe Course. We are accredited to perform the Genesee Academy Data Vault trainings.<br />Centennium’s customer Nutreco was awarded the world’s first Certified Data Vault Data Model in 2009 for their corporate financial and procurement data warehouse model.<br />
  42. 42. 32<br />
  43. 43. Centennium BI expertisehuis<br />Lange Voorhout 43<br />2514 EC 's-Gravenhage <br />Telefoon 070 31 20 370<br />Fax 070 31 20 371<br />URL www.centennium.nl<br />www.bi-opleidingen.nl<br /> www.data-vault.nl<br />

×