SlideShare a Scribd company logo
1 of 17
INTERMEDIATE TO
INFORMATION MANAGEMENT
                 IM03: Data Modeling




           Presented by Kelvin Chan
Introduction
• Meeting “Deliver More With Less” challenge, we need to leverage all
  resources especially data
• Data never lie and can input as a Historical Model that treat as
  Foundation
• The Time-proven method is through Dimensional Data structures.
• Organizations often struggle to develop Dimensional Models that
  consistently meet business needs due to less of knowledge and
  experience
What is Dimension?
• A set of Attributes describes the same
  Structural Thing
• Is a Business Perspective
• Eg. Date, Customer, Product, Salesman
How would we interpret the below statement?


• Sales Report by Store
   – A Report Stating the Measurement of Sales Figures by
     each Store
   – Store is Dimension
   – Sales Figures is Measure (Fact / Metric)
Degenerate Dimension
• Is a dimension key in the Fact Table that does not have its
  own Dimension Table, because all the concerned attributes
  have been placed in existing Dimension such as Salesman,
  Customer, Transaction Date
• Contains no attributes and hence does not join to any
  existing Dimension Table
Role-playing Dimension
• Dimensions are often recycled for multiple applications
  within the same database.
• Eg. Date Dimension can be used for Invoice Date, as well as
  Order Date, or Date of Birth
What does Key mean?
• Key is a unique identifier of the row. We have below Key in Database:
• Primary key. The Primary Unique Identifier of the row
• Foreign key. It is the other Table Primary Key. Sometime we call it a
  Dimension Key in Fact Table or Mapping Key or Look-up Key to
  Business Users
• Composite Key. A Unique Key that composite of two or more fields
  (attributes).
• Natural key. A Unique Key that is formed of attributes that already
  exist in the real world. For example, in Hong Kong, we have Hong Kong
  Identity Card Number (HKID no.) for each citizen and it is unique and
  also has a special meaning
• Surrogate key. A Unique Key with no business meaning. It normally
  generated by Database as Incremented Key or in SQL, MAX() + 1
Slowly Changing Dimension (SCD)
• Dimensions that change over time
• Typically, there are three type of SCD
• Type 1: Replace the entry with a new attributes
• Type 2: Create a new entry and mark the old record as
  outdated
• Type 3: Add additional column for each tracking attribute, eg.
  NAME, OLD_NAME
Recommendation on Which SCD Type?

• If you need to track the changes over time, a SCD Type II is
  recommended
• If you don’t care about the historical change on the
  captioned dimension, a SCD Type I is suggested
• In general, Data Warehouse seldom implement SCD Type II
Example on SCD Type II
Assume there is a new Customer
Profile created on 2009-01-22 and
with TOP30 attribute
                                    Custmer Attribute
 Customer Name   Created Date   TOP30     T300          T4
 Peter Chan      2009-01-22       Y
Initial Condition:
                                          Custmer Attribute
 Customer Name    Created Date      TOP30        T300         T4
 Peter Chan       2009-01-22          Y



           As of Date: 2009-01-22                       Custmer Attribute
Customer Name    Effective Start Effective End   TOP30        T300      T4
Peter Chan       2009-01-22      2099-12-31        Y
In Excel, we keep the record as below:
Attribute Change Log for Peter Chan
Initial Condition:
            As of Date: 2009-01-22                       Custmer Attribute
Customer Name     Effective Start Effective End   TOP30        T300      T4
Peter Chan        2009-01-22      2099-12-31        Y


New Conditions:

                        Journal
Customer Name     Effective Date Action      Attribute
Peter Chan        2009-05-01     Remove      TOP30
Peter Chan        2009-05-01     Add         T300




In Excel, we keep the record as below:

             As of Date: 2009-05-01                       Custmer Attribute
 Customer Name     Effective Start Effective End TOP30        T300     T4
 Peter Chan        2009-01-22      2009-04-30      Y
 Peter Chan        2009-05-01      2099-12-31                    Y
Initial Condition:
            As of Date: 2009-05-01                      Custmer Attribute
Customer Name    Effective Start Effective End TOP30        T300     T4
Peter Chan       2009-01-22      2009-04-30      Y
Peter Chan       2009-05-01      2099-12-31                    Y

New Condition:
                       Journal
Customer Name    Effective Date Action      Attribute
Peter Chan       2009-06-01     Add         TOP30



In Excel, we keep the record as below:

            As of Date: 2009-06-01                      Custmer Attribute
Customer Name    Effective Start   Effective End TOP30      T300     T4
Peter Chan       2009-01-22        2009-04-30      Y
Peter Chan       2009-05-01        2009-05-31                  Y
Peter Chan       2009-06-01        2099-12-31      Y           Y
IM03 - Data Modeling
IM03 - Data Modeling

More Related Content

Viewers also liked (6)

Quebec Raft Trip
Quebec Raft TripQuebec Raft Trip
Quebec Raft Trip
 
The power of storytelling in content marketing
The power of storytelling in content marketingThe power of storytelling in content marketing
The power of storytelling in content marketing
 
Analisis deskriptif dengan spss - Mawar Nazhira
Analisis deskriptif dengan spss - Mawar NazhiraAnalisis deskriptif dengan spss - Mawar Nazhira
Analisis deskriptif dengan spss - Mawar Nazhira
 
IM04 - BI Project Management
IM04 - BI Project ManagementIM04 - BI Project Management
IM04 - BI Project Management
 
Obesity - India
Obesity - IndiaObesity - India
Obesity - India
 
Catalunya nº 187
Catalunya nº 187Catalunya nº 187
Catalunya nº 187
 

Recently uploaded

Creating an Income Statement with Forecasts: A Simple Guide and Free Excel Te...
Creating an Income Statement with Forecasts: A Simple Guide and Free Excel Te...Creating an Income Statement with Forecasts: A Simple Guide and Free Excel Te...
Creating an Income Statement with Forecasts: A Simple Guide and Free Excel Te...
Aurelien Domont, MBA
 
A BUSINESS PROPOSAL FOR SLAUGHTER HOUSE WASTE MANAGEMENT IN MYSORE MUNICIPAL ...
A BUSINESS PROPOSAL FOR SLAUGHTER HOUSE WASTE MANAGEMENT IN MYSORE MUNICIPAL ...A BUSINESS PROPOSAL FOR SLAUGHTER HOUSE WASTE MANAGEMENT IN MYSORE MUNICIPAL ...
A BUSINESS PROPOSAL FOR SLAUGHTER HOUSE WASTE MANAGEMENT IN MYSORE MUNICIPAL ...
prakheeshc
 
00971508021841 حبوب الإجهاض في دبي | أبوظبي | الشارقة | السطوة |❇ ❈ ((![© ر
00971508021841 حبوب الإجهاض في دبي | أبوظبي | الشارقة | السطوة |❇ ❈ ((![©  ر00971508021841 حبوب الإجهاض في دبي | أبوظبي | الشارقة | السطوة |❇ ❈ ((![©  ر
00971508021841 حبوب الإجهاض في دبي | أبوظبي | الشارقة | السطوة |❇ ❈ ((![© ر
nafizanafzal
 
Obat Aborsi Pasuruan 0851\7696\3835 Jual Obat Cytotec Di Pasuruan
Obat Aborsi Pasuruan 0851\7696\3835 Jual Obat Cytotec Di PasuruanObat Aborsi Pasuruan 0851\7696\3835 Jual Obat Cytotec Di Pasuruan
Obat Aborsi Pasuruan 0851\7696\3835 Jual Obat Cytotec Di Pasuruan
Obat Aborsi Jakarta Wa 085176963835 Apotek Jual Obat Cytotec Di Jakarta
 

Recently uploaded (20)

hyundai capital 2023 consolidated financial statements
hyundai capital 2023 consolidated financial statementshyundai capital 2023 consolidated financial statements
hyundai capital 2023 consolidated financial statements
 
First Time Home Buyer's Guide - KM Realty Group LLC
First Time Home Buyer's Guide - KM Realty Group LLCFirst Time Home Buyer's Guide - KM Realty Group LLC
First Time Home Buyer's Guide - KM Realty Group LLC
 
Goal Presentation_NEW EMPLOYEE_NETAPS FOUNDATION.pptx
Goal Presentation_NEW EMPLOYEE_NETAPS FOUNDATION.pptxGoal Presentation_NEW EMPLOYEE_NETAPS FOUNDATION.pptx
Goal Presentation_NEW EMPLOYEE_NETAPS FOUNDATION.pptx
 
Creating an Income Statement with Forecasts: A Simple Guide and Free Excel Te...
Creating an Income Statement with Forecasts: A Simple Guide and Free Excel Te...Creating an Income Statement with Forecasts: A Simple Guide and Free Excel Te...
Creating an Income Statement with Forecasts: A Simple Guide and Free Excel Te...
 
Beyond Numbers A Holistic Approach to Forensic Accounting
Beyond Numbers A Holistic Approach to Forensic AccountingBeyond Numbers A Holistic Approach to Forensic Accounting
Beyond Numbers A Holistic Approach to Forensic Accounting
 
A BUSINESS PROPOSAL FOR SLAUGHTER HOUSE WASTE MANAGEMENT IN MYSORE MUNICIPAL ...
A BUSINESS PROPOSAL FOR SLAUGHTER HOUSE WASTE MANAGEMENT IN MYSORE MUNICIPAL ...A BUSINESS PROPOSAL FOR SLAUGHTER HOUSE WASTE MANAGEMENT IN MYSORE MUNICIPAL ...
A BUSINESS PROPOSAL FOR SLAUGHTER HOUSE WASTE MANAGEMENT IN MYSORE MUNICIPAL ...
 
wagamamaLab presentation @MIT 20240509 IRODORI
wagamamaLab presentation @MIT 20240509 IRODORIwagamamaLab presentation @MIT 20240509 IRODORI
wagamamaLab presentation @MIT 20240509 IRODORI
 
Innomantra Viewpoint - Building Moonshots : May-Jun 2024.pdf
Innomantra Viewpoint - Building Moonshots : May-Jun 2024.pdfInnomantra Viewpoint - Building Moonshots : May-Jun 2024.pdf
Innomantra Viewpoint - Building Moonshots : May-Jun 2024.pdf
 
Elevate Your Online Presence with SEO Services
Elevate Your Online Presence with SEO ServicesElevate Your Online Presence with SEO Services
Elevate Your Online Presence with SEO Services
 
Moradia Isolada com Logradouro; Detached house with patio in Penacova
Moradia Isolada com Logradouro; Detached house with patio in PenacovaMoradia Isolada com Logradouro; Detached house with patio in Penacova
Moradia Isolada com Logradouro; Detached house with patio in Penacova
 
Pay after result spell caster (,$+27834335081)@ bring back lost lover same da...
Pay after result spell caster (,$+27834335081)@ bring back lost lover same da...Pay after result spell caster (,$+27834335081)@ bring back lost lover same da...
Pay after result spell caster (,$+27834335081)@ bring back lost lover same da...
 
MichaelStarkes_UncutGemsProjectSummary.pdf
MichaelStarkes_UncutGemsProjectSummary.pdfMichaelStarkes_UncutGemsProjectSummary.pdf
MichaelStarkes_UncutGemsProjectSummary.pdf
 
1Q24_EN hyundai capital 1q performance
1Q24_EN   hyundai capital 1q performance1Q24_EN   hyundai capital 1q performance
1Q24_EN hyundai capital 1q performance
 
Progress Report - UKG Analyst Summit 2024 - A lot to do - Good Progress1-1.pdf
Progress Report - UKG Analyst Summit 2024 - A lot to do - Good Progress1-1.pdfProgress Report - UKG Analyst Summit 2024 - A lot to do - Good Progress1-1.pdf
Progress Report - UKG Analyst Summit 2024 - A lot to do - Good Progress1-1.pdf
 
00971508021841 حبوب الإجهاض في دبي | أبوظبي | الشارقة | السطوة |❇ ❈ ((![© ر
00971508021841 حبوب الإجهاض في دبي | أبوظبي | الشارقة | السطوة |❇ ❈ ((![©  ر00971508021841 حبوب الإجهاض في دبي | أبوظبي | الشارقة | السطوة |❇ ❈ ((![©  ر
00971508021841 حبوب الإجهاض في دبي | أبوظبي | الشارقة | السطوة |❇ ❈ ((![© ر
 
Obat Aborsi Pasuruan 0851\7696\3835 Jual Obat Cytotec Di Pasuruan
Obat Aborsi Pasuruan 0851\7696\3835 Jual Obat Cytotec Di PasuruanObat Aborsi Pasuruan 0851\7696\3835 Jual Obat Cytotec Di Pasuruan
Obat Aborsi Pasuruan 0851\7696\3835 Jual Obat Cytotec Di Pasuruan
 
South Africa's 10 Most Influential CIOs to Watch.pdf
South Africa's 10 Most Influential CIOs to Watch.pdfSouth Africa's 10 Most Influential CIOs to Watch.pdf
South Africa's 10 Most Influential CIOs to Watch.pdf
 
Home Furnishings Ecommerce Platform Short Pitch 2024
Home Furnishings Ecommerce Platform Short Pitch 2024Home Furnishings Ecommerce Platform Short Pitch 2024
Home Furnishings Ecommerce Platform Short Pitch 2024
 
Exploring-Pipe-Flanges-Applications-Types-and-Benefits.pptx
Exploring-Pipe-Flanges-Applications-Types-and-Benefits.pptxExploring-Pipe-Flanges-Applications-Types-and-Benefits.pptx
Exploring-Pipe-Flanges-Applications-Types-and-Benefits.pptx
 
High Profile Bangalore Just VIP Brigade Road 100% Genuine at your Door Step
High Profile Bangalore Just VIP Brigade Road 100% Genuine at your Door StepHigh Profile Bangalore Just VIP Brigade Road 100% Genuine at your Door Step
High Profile Bangalore Just VIP Brigade Road 100% Genuine at your Door Step
 

IM03 - Data Modeling

  • 1. INTERMEDIATE TO INFORMATION MANAGEMENT IM03: Data Modeling Presented by Kelvin Chan
  • 2. Introduction • Meeting “Deliver More With Less” challenge, we need to leverage all resources especially data • Data never lie and can input as a Historical Model that treat as Foundation • The Time-proven method is through Dimensional Data structures. • Organizations often struggle to develop Dimensional Models that consistently meet business needs due to less of knowledge and experience
  • 3. What is Dimension? • A set of Attributes describes the same Structural Thing • Is a Business Perspective • Eg. Date, Customer, Product, Salesman
  • 4. How would we interpret the below statement? • Sales Report by Store – A Report Stating the Measurement of Sales Figures by each Store – Store is Dimension – Sales Figures is Measure (Fact / Metric)
  • 5. Degenerate Dimension • Is a dimension key in the Fact Table that does not have its own Dimension Table, because all the concerned attributes have been placed in existing Dimension such as Salesman, Customer, Transaction Date • Contains no attributes and hence does not join to any existing Dimension Table
  • 6. Role-playing Dimension • Dimensions are often recycled for multiple applications within the same database. • Eg. Date Dimension can be used for Invoice Date, as well as Order Date, or Date of Birth
  • 7. What does Key mean? • Key is a unique identifier of the row. We have below Key in Database: • Primary key. The Primary Unique Identifier of the row • Foreign key. It is the other Table Primary Key. Sometime we call it a Dimension Key in Fact Table or Mapping Key or Look-up Key to Business Users • Composite Key. A Unique Key that composite of two or more fields (attributes). • Natural key. A Unique Key that is formed of attributes that already exist in the real world. For example, in Hong Kong, we have Hong Kong Identity Card Number (HKID no.) for each citizen and it is unique and also has a special meaning • Surrogate key. A Unique Key with no business meaning. It normally generated by Database as Incremented Key or in SQL, MAX() + 1
  • 8. Slowly Changing Dimension (SCD) • Dimensions that change over time • Typically, there are three type of SCD • Type 1: Replace the entry with a new attributes • Type 2: Create a new entry and mark the old record as outdated • Type 3: Add additional column for each tracking attribute, eg. NAME, OLD_NAME
  • 9. Recommendation on Which SCD Type? • If you need to track the changes over time, a SCD Type II is recommended • If you don’t care about the historical change on the captioned dimension, a SCD Type I is suggested • In general, Data Warehouse seldom implement SCD Type II
  • 10. Example on SCD Type II
  • 11. Assume there is a new Customer Profile created on 2009-01-22 and with TOP30 attribute Custmer Attribute Customer Name Created Date TOP30 T300 T4 Peter Chan 2009-01-22 Y
  • 12. Initial Condition: Custmer Attribute Customer Name Created Date TOP30 T300 T4 Peter Chan 2009-01-22 Y As of Date: 2009-01-22 Custmer Attribute Customer Name Effective Start Effective End TOP30 T300 T4 Peter Chan 2009-01-22 2099-12-31 Y In Excel, we keep the record as below:
  • 13. Attribute Change Log for Peter Chan
  • 14. Initial Condition: As of Date: 2009-01-22 Custmer Attribute Customer Name Effective Start Effective End TOP30 T300 T4 Peter Chan 2009-01-22 2099-12-31 Y New Conditions: Journal Customer Name Effective Date Action Attribute Peter Chan 2009-05-01 Remove TOP30 Peter Chan 2009-05-01 Add T300 In Excel, we keep the record as below: As of Date: 2009-05-01 Custmer Attribute Customer Name Effective Start Effective End TOP30 T300 T4 Peter Chan 2009-01-22 2009-04-30 Y Peter Chan 2009-05-01 2099-12-31 Y
  • 15. Initial Condition: As of Date: 2009-05-01 Custmer Attribute Customer Name Effective Start Effective End TOP30 T300 T4 Peter Chan 2009-01-22 2009-04-30 Y Peter Chan 2009-05-01 2099-12-31 Y New Condition: Journal Customer Name Effective Date Action Attribute Peter Chan 2009-06-01 Add TOP30 In Excel, we keep the record as below: As of Date: 2009-06-01 Custmer Attribute Customer Name Effective Start Effective End TOP30 T300 T4 Peter Chan 2009-01-22 2009-04-30 Y Peter Chan 2009-05-01 2009-05-31 Y Peter Chan 2009-06-01 2099-12-31 Y Y