Architecting a Data Warehouse: A Case Study

Loading...

Flash Player 9 (or above) is needed to view presentations.
We have detected that you do not have it on your computer. To install it, go here.

0 comments

Post a comment

    Post a comment
    Embed Video
    Edit your comment Cancel

    3 Favorites

    Architecting a Data Warehouse: A Case Study - Presentation Transcript

    1. ARCHITECTING A DATA WAREHOUSE: A CASE STUDY Project: zBis Carl Zeiss Vision North America SPEAKER: ELIZABETH DIAMOND SAN FRANCISCO SQL SERVER USER GROUP SEPTEMBER 9, 2009 MARK GINNEBAUGH, USER GROUP LEADER www.bayareasql.org
    2. The Journey Determined Need for Enterprise Data Warehouse Worked with Business Users to Understand Business Requirements Determined Software Requirements MS SQL Server 2005 & 2008 MS SSIS (ETL Tool) MS SSAS (Analytic Cube Tool) MS SSRS & Excel (Reporting Tools) SharePoint for Deploying Reports over Company Intranet Designed and Developed zBis Data Warehouse
    3. Z BIS = What We Will Deliver This project team will deliver the following: X Consolidated reporting for Carl Zeiss Vision North America X Reporting that is consistent and from one data warehouse X Reporting that is easy to use and easy to access X Toolset will be flexible and able to grow and change with our business X Phase I rock solid download from ERP/Manf – Providing ability to review lab information as a lab network – not individual silos – with accurate reporting across all products and services We will deliver the best product possible based on the information we can place in our data warehouse!
    4. • Reporting from cubes – off source systems only – No data warehouse • Disparate data systems with different results from each • Most systems not balanced to GL • Reporting for each business unit only • No reporting across all business units
    5. Transactional Cube of Approach Sales Queries Other Reports Sales Reports Corporate Download Data Mart Data Mart Data Mart Finance Inventory Sales & Marketing ETL Loads ETL Load ODS/Staging Operational Data Store ETL Load ERP Manufacturing Other
    6. BI Tools/Analytics Active Excel Static Reports Reports PerformancePoint Server SharePoint SQL SQL Analytics Reporting Server (SSAS) Server Aggregated Finance Inventory Sales Data Mart Data Mart Data Mart Data Mart TBD ETL Load (SSIS) Data Warehouse ETL Load (SSIS) ODS/Staging Operational Data Store ETL Load (SSIS) ERP Manufacturing SW Other Data Sources
    7. Introduction to Data Warehousing What is a Data Warehouse System Why a Data Warehouse Vs. Cubes on Source Systems Star Schema Vs. Transactional Data Warehouses Star Schemas ease of system integrating Star Schemas provide substantial performance gains Star Schemas hierarchy capabilities or Drill Down Capabilities Ralph Kimball Developed Current Industry Standards for Star Schema – Dimensions and Facts
    8. Data Warehouse Project Lifecycle Technical Product Architecture Selection & Design Installation Project Business Data Staging Testing Planning Dimensional Physical Requirement Design & ETL & Deployment Maintenance Modeling Design Definition Development DW/DM Report Report Report Specifications Development Testing Project Management
    9. 4 + 1 – Steps Dimensional Design Process Ralph Kimball’s Process for Developing Star Schemas 1. Determine Business Process Model business Processes Each Process will determine 1 or more Facts Design DW by Business Process Not Business Unit 2. Identify the Grain of the Fact • What does 1 row in Fact table represent • Transactional or Summary 3. Design the DW Dimensions 4. Design the DW Facts +1 Determine Hierarchies
    10. Business Driven vs. Data Driven Design DW/BI System via Business Process Develop DW/BI System via Data from Source Systems Profile Data as early as possible Understand data and design DW using existing data Design & Develop using both Business Process and available Data if possible
    11. Understanding Your Business Identify key business sponsors for DW project Use Corporate Org Chart Setup initial interviews with key sponsors Develop Business Process diagrams Develop high level Use Case Diagrams Determine Business Hierarchies
    12. The Business Executive Interview • What are the objectives of your organization? • What Business goals do you want to accomplish with the development of zBis data warehouse System? • How do you measure success? How do you know you are doing well? How often do you measure your corporate performance? • What are your key business issues that you are trying to solve from the zBis system? If these issues are not justified what is the impact to your department and organization?
    13. The Business Executive Interview • How do you identify problems or know when you might be headed for trouble? • How do you spot exceptions in your business? What opportunities exist to dramatically impact your business based on improved access to information? What is the financial impact • If you could….., What would it mean to your business? • What is your vision to better leverage information within your organization? • How do you anticipate that your staff will interact directly with this information?
    14. The Business Manager Interview • What are the objectives of your department? • What are you trying to accomplish? How would do you go about achieving your objectives? • What are your success metrics? • How do you know you are doing well? • How often do you measure your department/team? • How do you anticipate that your staff will interact directly with this information?
    15. Business Process Diagrams Understand Business Requirements for building DW/BI system. Defines the Measures and Dimensions for data warehouse
    16. Determine Hierarchies Customer Hierarchies – Sales Channels Distribution Channels Business Channels Customer Channels Product Divisions Sales Organizations Sales Office Buy Groups/Directly Purchase
    17. Determine Hierarchies Product Hierarchy Manufacturer Brand Product Type – Each product type had own Hierarchy Lens Service Equipment etc… Design Make/Model
    18. Determine Hierarchies Geo Hierarchy Sales Division Sales Region Sales Territory
    19. Conformed Dimensions Standardized dimensions across data warehouse Dimensions are associated with multiple business processes Determine by using Bus Matrix & enforced in ETL Conformed Dimensions are shared and consistent across fact tables
    20. Use Data Warehouse BUS Matrix Use Data Warehouse BUS Matrix for Understanding & mapping of Business Processes and Dimensions Ongoing DW/BI planning efforts Team & Management Communications Understand Business Process unions across the enterprise
    21. Data Warehouse BUS Matrix Date Company Customer Product Geo Dist Ctr Promo Company X X X X X X Sales Customer X X X X X X Discounts Product X X X X X X X Cost Company X X X Inventory Dist Ctr X X X Inventory
    22. Develop Dimensional Schema
    23. Slow Changing Dimensions Type 1 – Overwrite existing Dimension Row Use when don’t need to keep history data row Can be used to correct bad data Type 2 – Create a new Dimension Row Use date and/or active non-active fields to identify current and inactive data rows Type 3 – Keep old and add new attributes in Dimension Row Allow Alternate realities to exist simultaneously in one Dimension Row Slow Changing Dimensions are handled in the ETL
    24. Type of Dimensions Mini-Dimension Junk Dimensions Outrigger Dimensions Small Static Dimensions Lookup tables
    25. Type of Facts Transaction Fact Tables Snapshot Fact Tables Accumulating Snapshot Fact Tables Consolidated or Aggregated Fact Tables
    26. Bridge Tables
    27. Bridge Tables
    28. Recommended Reading list The Data Warehouse Toolkit: The Complete Guide to Dimensional Modeling (Second Edition) by Ralph Kimball and Margy Ross The MicrosoftData Warehouse Toolkit: With SQL Server2005 and the MicrosoftBusiness Intelligence Toolset by Joy Mundy, Warren Thornthwaite, and Ralph Kimball Building a Data Warehouse: With Examples in SQL Server (Expert's Voice) by Vincent Rainardi The Data Warehouse Lifecycle Toolkit by Ralph Kimball, Margy Ross, Warren Thornthwaite, and Joy Mundy The Data Warehouse ETL Toolkit: Practical Techniques for Extracting, Cleanin by Ralph Kimball and Joe Caserta
    29. Elizabeth Diamond LSI Data Management / Partner with DesignMind Sr. Data Warehouse Architect lizd@techrecover.com Phone: 415-990-8204
    30. www.bayareasql.org To attend our meetings or inquire about speaking opportunities, please contact: Mark Ginnebaugh, User Group Leader mark@designmind.com

    + Mark GinnebaughMark Ginnebaugh, 2 months ago

    custom

    2066 views, 3 favs, 0 embeds more stats

    Best practices and tips on how to design and develo more

    More info about this document

    © All Rights Reserved

    Go to text version

    • Total Views 2066
      • 2066 on SlideShare
      • 0 from embeds
    • Comments 0
    • Favorites 3
    • Downloads 127
    Most viewed embeds

    more

    All embeds

    less

    Flagged as inappropriate Flag as inappropriate
    Flag as inappropriate

    Select your reason for flagging this presentation as inappropriate. If needed, use the feedback form to let us know more details.

    Cancel
    File a copyright complaint
    Having problems? Go to our helpdesk?

    Categories