Your SlideShare is downloading. ×
0
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Building Agile Data Warehouses with Ralph Hughes
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Building Agile Data Warehouses with Ralph Hughes

3,204

Published on

Ralph Hughes, TDWI faculty member, author and 25-year veteran of DW and BI projects for Fortune 500 companies, shares his thoughts on accelerated enterprise data warehousing. More info & webinar …

Ralph Hughes, TDWI faculty member, author and 25-year veteran of DW and BI projects for Fortune 500 companies, shares his thoughts on accelerated enterprise data warehousing. More info & webinar replay can be found here http://blog.kalido.com/building-agile-data-warehouses-ralph-hughes-webinar/

Published in: Technology
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
3,204
On Slideshare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
156
Comments
0
Likes
3
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Building Agile Data Warehouses Kalido Lessons From Leaders Webcast Series Featuring Ralph Hughes1 March 22, 2012 Kalido © I Kalido Confidential I March 22, 2012
  • 2. Logistics Attendees will be on mute for the call Type your questions into the Questions box Webcast is being recorded and will be available for replay Request a copy of today’s slides by sending an email to: marketing@kalido.com Join the conversation online by using the #Kalido hashtag. Follow us @kalido2 March 22, 2012 Kalido © I Kalido Confidential I March 22, 2012
  • 3. Today’s Speakers Ralph Hughes Chief Systems Architect, Ceregenics John Evans Director of Product Marketing, Kalido3 March 22, 2012 Kalido © I Kalido Confidential I March 22, 2012
  • 4. Discussion Topics Waterfall vs. Agile Methods Benefits of an Agile Approach How to Implement Agile Methods with Agile Tools Q&A4 March 22, 2012 Kalido © I Kalido Confidential I March 22, 2012
  • 5. Ralph Hughes, MA, PMP, CSM Chief Systems ArchitectBUILDING AGILE DATA WAREHOUSES
  • 6. WATERFALL AND PROJECT RESOURCESSystem Reqs S/w Reqs Analysis Design Coding Testing OperationsSingle Pass Copyright © 2012, Ceregenics. www.ceregenics.com Slide 6
  • 7. AGILE DW/BI IN A NUTSHELL The “Project Backlog”Prioritized for value and dependencies 6 to 10 developers + iterative method Promote to production A growing “release pool” Copyright © 2012, Ceregenics. www.ceregenics.com Slide 7
  • 8. WATERFALL HANDOFF TAKE FOREVER Project Architects Data Modelers ETL Designers last 20% last 20% last 20% 80% of the value 80% of the value 80% of the value Waterfall Project Start-Up Time Copyright © 2012, Ceregenics. www.ceregenics.com Slide 8
  • 9. AGILE IS RECURSIVE 80/20 Coding Collaboration between specialties so that one Specs person is always within their comfort zone...this Data Model is where agile gets much of its speed Vision RequirementsAgile 80% Time & Cost SavingsWaterfall 100% 100% 100% 100% 100% Copyright © 2012, Ceregenics. www.ceregenics.com Slide 9
  • 10. INMON/KIMBALL PARALYSIS Project EDW Architect Architect Sources 3NF Star Copyright © 2012, Ceregenics. www.ceregenics.com Slide 10
  • 11. INMON/KIMBALL PARALYSIS Project EDW Architect Architect Release 1 Compromise Sources               3NF     Star Copyright © 2012, Ceregenics. www.ceregenics.com Slide 11
  • 12. STARTING POINT: 3NF Starts with 7 tables Copyright © 2012, Ceregenics. www.ceregenics.com Slide 12
  • 13. STEP 1: IDENTIFY PIVOTAL BUSINESS KEYS Copyright © 2012, Ceregenics. www.ceregenics.com Slide 13
  • 14. STEP 2: TRANSITION TO “LINKS” Copyright © 2012, Ceregenics. www.ceregenics.com Slide 14
  • 15. STEP 3: SEPARATE OUT CONTEXT From 7 to 16 tables Copyright © 2012, Ceregenics. www.ceregenics.com Slide 15
  • 16. STEP 4: EXTEND FOR NEW REQUIREMENTS Note: No impact upon rest of model! “Three-Way Robust”  build in little pieces  re-engineer with small scope  scales linearly Copyright © 2012, Ceregenics. www.ceregenics.com Slide 16
  • 17. EXAMPLE: SPONSORED IMMIGRATION DM Project Sponsor: “Can’t DWBI focus first on just the key integration points, get some basic counts, and then go back to add in all the complex attributes?” Copyright © 2012, Ceregenics. www.ceregenics.com Slide 17
  • 18. AGILE BI FOR SPONSORED IMMIGRATION Copyright © 2012, Ceregenics. www.ceregenics.com Slide 18
  • 19. APP GENERATORS LET YOU SKIP STEPSTraditional Logical Physical Integration Dimensional Semantic BI Data Model Data Model Layer Layer Layer Layer 90% Integration-Layer Generator Copyright © 2012, Ceregenics. www.ceregenics.com Slide 19
  • 20. MODEL-DRIVEN DEV: ASSOCIATIVE ENGINES Thing Link Types Types Logical Business Model Generates Sem Star Int Physical Data Objects & ETL Copyright © 2012, Ceregenics. www.ceregenics.com Slide 20
  • 21. APP GENERATORS LET YOU SKIP STEPSTraditional Logical Physical Integration Dimensional Semantic BI Data Model Data Model Layer Layer Layer Layer 90% Integration-Layer Generator 90% Model-Driven Application Generator Copyright © 2012, Ceregenics. www.ceregenics.com Slide 21
  • 22. WATERFALL VS. BUSINESS-IT ALIGNMENTBusiness “Digest Data” “Digest” Time IT Customer Customer Touch Touch Point Point Build Big Fix Copyright © 2012, Ceregenics. www.ceregenics.com Slide 22
  • 23. AGILE’S IMPACT ON THE ENTERPRISE Customer Touch Points “Digest Data”Business Time IT Value of Agile Warehousing First release Traditional Phase 2 Copyright © 2012, Ceregenics. www.ceregenics.com Slide 23
  • 24. Traditional Approach Extends Time To Decision Making Business ValueTraditional Time to DeliverAdapted from “The Time Value Curve” by Dr. Richard Hackathorn, Bolder Technology Inc. 24 March 22, 2012 Kalido © I Kalido Confidential I March 22, 2012
  • 25. Evolution Of Tools And Methods Agility Requires a New Approach and Supporting Technology Need to acknowledge that things change Architecture that enables integration and incremental builds Optimized and automated processes for optimal performance End-to-end governance to ensure semantic consistency and quality Formal agile methodology to deliver rapidly and support change Extract maximum value from each step in the process Maintain connection to the business25 March 22, 2012 Kalido © I Kalido Confidential I March 22, 2012
  • 26. Centrally Capture Requirements26 March 22, 2012 Kalido © I Kalido Confidential I March 22, 2012
  • 27. Model-Driven Automation Modeling Data Integration Star and Snowflake Schema Data Sourcing and Field Mapping Code Management and Lookup Testing Physical Schema Management Delta Detection Suspense and Exception Handling Built-in Integrity Checking Slowly Changing Dimensions Data Validation Currency and Units of Measure Aggregate Task Results System Key Management Contra Processing Data Mart and Aggregates Excel Integration for User reconciliation Data Export & Purging Post Processing HousekeepingData Load and Index Management Data rollback and batch reload for system test Rollup Path Awareness User Interface for data browsing & Business Information Model Driven Automation troubleshootingIncremental Summary Generation Convert Existing Logical Models Name & Label Management Release to Production Version Management BI Delivery Object level Change Management Native QlikView GenerationNative XLS Pivot Table Generation Model Migration Operations Generic Export/ Import for Data MigrationMetadata Management for COGN Task Execution & Monitoring Process AutomationMetadata Management for BOBJ Object Level Dependency Deployment and Migration Archiving for Migration VersionsMetadata Management for MSAS Restore for Model and Data Undo Loads Model Comparison ReportReport-Time Formula Management Audit and Logging Job Definition with Dependency 27 March 22, 2012 Kalido © I Kalido Confidential I March 22, 2012
  • 28. Iterative Agile Approach Define Phase Detail Requirements & Design Iterate Phase • Adaptive Project Management • Version Control Build Configure Phase & Load Test & Validate28 March 22, 2012 Kalido © I Kalido Confidential I March 22, 2012
  • 29. Shorten The Cycle, Maximize Business Value Business Value Kalido Business Value Benefit Time to Value BenefitTraditional Time to DeliverAdapted from “The Time Value Curve” by Dr. Richard Hackathorn, Bolder Technology Inc. 29 March 22, 2012 Kalido © I Kalido Confidential I March 22, 2012
  • 30. Architecture That Supports Incremental BuildDataMart 1 Expand rather than rebuild30 March 22, 2012 Kalido © I Kalido Confidential I March 22, 2012
  • 31. Architecture That Supports Incremental BuildDataMart 1DataMart n Expand rather than rebuild Leverage existing value and build incrementally31 March 22, 2012 Kalido © I Kalido Confidential I March 22, 2012
  • 32. Architecture That Supports Incremental Build Data Mart 1 Data Mart n Expand rather than rebuildNew Requirement Leverage existing value and build incrementally Pay as you grow rather than huge upfront capital expenditures 32 March 22, 2012 Kalido © I Kalido Confidential I March 22, 2012
  • 33. Warehouse Expansion By Subject Area Material Valuation AR Balance Sheet Bill of Material Component Cost Customer Contacts Demand Planning Financial Plan Income Statement Plant Level Delivery Profitability Analysis Repack Activity SAP Inventory Adjustments Stock Transfer Orders Vendor Inventory Bill of Material Inventory Age POC Execution Statistics Revenue Recognition Sales Sales Visit Target Shelf Life Variable Sales Compensation Account Expenses Account Statistics Price Account Mappings Telesales Inventory Telesales Inventory Strike Rate Truck Loads Daily Inventory Reporting (LCBO) Territory Supplementary Expenses Consumer Price Survey Management Inventory Reporting (LCBO) POC Survey Distribution Trade Spend Bookings Liquor Control Board Product Mapping Trip Management US Distribution US MovementsBusiness Metrics Covered US Product Margin US Production Plan US Telesales Targets Trade Spend Wholesaler Profitability CRM Sales Plans US Sales Visit Management Customer Survey Management POC Surveys IT Services Actuals US Account Manager Targets IT Services Budget US Retail Account Management Targets IT Services Targets US Retail Sales US Wholesaler Profitability US Sales Workers Compensation Management Telesales Plan Market Share Sales Visit Management Telesales Targets Key Account Sales Targets Price Variance Reporting Sales Orders Daily Inventory WIP Job Production ABC HR Accident Management External Distributor Product Substitution Production Complexity Warehouse Productivity Commercial Sales Targets Production Schedules In Transit Inventory Production Yield Line Speeds Product Level Shipments PDA Expenses Split-Week Demand Plan Production Storage Targets Production FTE Targets Target Production Loss Production FTE Utilization Utility Usage & Targets Production Loss Distribution Targets Product Repackaging Sales Targets Standard Pricing Channel Distribution Volatile Sales Planning Product Account Distribution Reseller Sales Account Product Distribution Brand Costs Product Distribution Brand Profitability Product Margin Cost of Sales Product Substitution Daily Sales Sales Actuals Financial Balances Sales Expenses FX Sales Plan Key Account Mgt Brand Level Shipments Pricing Weekly/ Monthly Demand Plan 2004Q2 2004Q3 2004Q4 2005Q1 2005Q2 2005Q3 2005Q4 2006Q1 2006Q2 2006Q3 2006Q4 2007Q1 2007Q2 2007Q3 2007Q4 2008Q1 2008Q2 2008Q3 2008Q4 2009Q2 2010Q1 2010Q2 2010Q3 Time Progression by Quarter33 March 22, 2012 Kalido © I Kalido Confidential I March 22, 2012
  • 34. The Kalido Solution Software automation for data warehousing that runs in database and eliminates lots of labor that is typically required to design, build, and change the analytic foundation Data Data Infrastructure Business Sources Intelligence Governance and Stewardship Financial Regulatory CRM Finance Logical Modeling analytics Reporting BI Semantics Mart Data ETL Sales Executive SCM ERP Mart Analytics Dashboard Warehouse Mart Automation Customer Margin Legacy External Physical DBMS Design Analytics Analysis34 March 22, 2012 Kalido © I Kalido Confidential I March 22, 2012
  • 35. Agility To The Extreme Antiquated big-bang methods and siloed approaches are giving way to well-managed Agile methodologies Agile methods provide short term value without sacrificing long term goals Agile tools to automate the mechanics of modeling, design, data integration, data access, test and release to production reduce risk and shorten time to value Pay-as-you-grow smoothes the cost curve and allows your budgets to stay in sync with derived value35 March 22, 2012 Kalido © I Kalido Confidential I March 22, 2012
  • 36. Next Steps Attendees will receive our whitepaper on “Ensuring Agility in Your Data Warehouse” and a free chapter from Ralph’s book Download Kalido Business Information Modeler http://www.kalido.com/business-modeling-community.htm Take the Kalido Challenge – http://info.kalido.com/kalido_challenge.html Read our blog about Kalido Information Engine http://blog.kalido.com/category/information-engine/ Contact us! +1.781.202.3200, press 136 March 22, 2012 Kalido © I Kalido Confidential I March 22, 2012
  • 37. Thank you for attending!37 March 22, 2012 Kalido © I Kalido Confidential I March 22, 2012

×