This document outlines the approach and summary of a course on data warehousing and mining. The course aims to develop an understanding of relational database concepts and how they apply and break down in very large databases and data warehousing. It will cover topics like online analytical processing, dimensional modeling, extract-transform-load, data quality management, and data mining concepts. The course also provides an overview of important reference books on data warehousing.

1. Dr. Abdul Basit Siddiqui
Assistant Professor
FURC
(Lecture Slides Week # 2)

2. Approach of the Course
Develop an understanding of the underlying RDBMS
concepts.
Apply these concepts to VLDB / DSS environments and
understand where and why they break down?
Expose the differences between RDBMS and Data
Warehouse in the context of VLDB.
Provide the basics of DSS tools such as OLAP, Data
Mining and demonstrate their applications.
Demonstrate the application of DSS concepts and
limitations of the OLTP concepts through lab exercises.
04/19/15 2Data Warehoue & Mining - Spring 2014

3. Summary of the Course
Introduction & Background
De-Normalization
Online Analytical Processing (OLAP)
Dimensional Modeling
Extract-Transform-Load (ETL)
Data Quality Management (DQM)
Parallelism, Join and Indexing Techniques
Data Mining Concepts
Data Cleansing
Association Rule Mining
Clustering
Classification
04/19/15 3Data Warehoue & Mining - Spring 2014

4. BooksReference Books
W. H. Inmon, Building the Data Warehouse,
John Wiley & Sons Inc., NY
R. Kimball, The Data Warehouse Toolkit,
John Wiley & Sons Inc., NY
Paulraj Ponniah, Data Warehousing
Fundamentals, John Wiley & Sons Inc., NY
04/19/15 4Data Warehoue & Mining - Spring 2014

6. Why this Course?
The World is changing / (in fact changed)
Either change or Be left behind.
Missing the opportunities or going in the wrong
direction has prevented us from growing.
What is the right direction?
harnessing the data, in the knowledge driven economy.
Doing what can’t be or difficult to automate.
04/19/15 6Data Warehoue & Mining - Spring 2014

7. Historical Overview
1960: Master Files and Reports
1965: Lots of Master Files
1970: Direct Memory Access and DBMS
1975: Online High Performance Transaction
Processing
1980: PCs and 4GL Technology (MIS/DSS)
1985: Extract Programs, Extract Processing
1990: The Legacy System’s Web
04/19/15 7Data Warehoue & Mining - Spring 2014

8. The Need of the Time
drowning in data AND/BUT starving for information.
Knowledge is power BUT Intelligence is
absolute/super power.
04/19/15 8Data Warehoue & Mining - Spring 2014

9. The Need of the Time
04/19/15
Data
Information
Knowledge
Intelligence
POWER
($/£)
9Data Warehoue & Mining - Spring 2014

10. 04/19/15
ABC Pvt Ltd is a company with branches at
Karachi, Quetta, Peshawar and Lahore. The Sales
Manager wants quarterly sales report. Each
branch has a separate operational system.
10Data Warehoue & Mining - Spring 2014

11. 04/19/15
Karachi
Quetta
Peshawar
Lahore
Sales
Manager
Sales per item type per branch
for first quarter.
11Data Warehoue & Mining - Spring 2014

12. Solution 1:ABC Pvt Ltd.
Extract sales information from each database.
Store the information in a common repository
at a single site.
04/19/15 12Data Warehoue & Mining - Spring 2014

13. 04/19/15
Karachi
Quetta
Peshawar
Lahore
Data
Warehouse
Sales
Manager
Query &
Analysis tools
Report
13Data Warehoue & Mining - Spring 2014

14. 04/19/15
One Stop Shopping Super Market has huge
operational database. Whenever Executives wants
some report, the OLTP system becomes slow and
data entry operators have to wait for some time.
14Data Warehoue & Mining - Spring 2014

15. 04/19/15
Operational
Database
Data Entry Operator
Data Entry Operator
ManagementWait
Report
15Data Warehoue & Mining - Spring 2014

16. Solution 2
Extract data needed for analysis from
operational database.
Store it in warehouse.
Refresh warehouse at regular interval so that it
contains up to date information for analysis.
Warehouse will contain data with historical
perspective.
04/19/15 16Data Warehoue & Mining - Spring 2014

17. 04/19/15
Operational
database
Data
Warehouse
Extract
data
Data Entry
Operator
Data Entry
Operator
Manager
Report
Transaction
17Data Warehoue & Mining - Spring 2014

18. 04/19/15
Cakes & Cookies is a small, new company. President
of the company wants his company should grow. He
needs information so that he can make correct
decisions.
18Data Warehoue & Mining - Spring 2014

19. Solution 3
Improve the quality of data before loading it into the
warehouse.
Perform data cleaning and transformation before
loading the data.
Use query analysis tools to support adhoc queries.
04/19/15 19Data Warehoue & Mining - Spring 2014

20. 04/19/15
Query and Analysis
tool
President
Expansion
Improvement
sales
time
Data
Warehouse
20Data Warehoue & Mining - Spring 2014

21. Case Study
AFCO Foods & Beverages is a new company
which produces dairy, bread and meat products
with production unit located at Gujranwala.
There products are sold in all the region of
Pakistan.
They have sales units at provincial Head
Quarters.
The President of the company wants sales
information.
04/19/15 21Data Warehoue & Mining - Spring 2014

22. Sales Information
January February March April
14 41 33 25
04/19/15
Report: The number of units sold.
113
Report: The number of units sold over time
22Data Warehoue & Mining - Spring 2014

23. Sales Information
Jan Feb Mar Apr
Wheat Bread 6 17
Cheese 6 16 6 8
Swiss Rolls 8 25 21
04/19/15
Report : The number of items sold for each product with
time
Product
Time
23Data Warehoue & Mining - Spring 2014

24. Sales Information
Jan Feb Mar Apr
Karachi Wheat
Bread
3 10
Cheese 3 16 6
Swiss Rolls 4 16 6
Lahore Wheat
Bread
3 7
Cheese 3 8
Swiss Rolls 4 9 15
04/19/15
Report: The number of items sold in each City for each
product with time
Product
Time
City
24Data Warehoue & Mining - Spring 2014

25. 04/19/15
Report: The number of items sold and income in each region for
each product with time.
Jan Feb Mar Apr
Rs U Rs U Rs U Rs U
Karachi Wheat Bread 7.44 3 24.80 10
Cheese 7.95 3 42.40 16 15.90 6
Swiss Rolls 7.32 4 29.98 16 10.98 6
Lahore Wheat Bread 7.44 3 17.36 7
Cheese 7.95 3 21.20 8
Swiss Rolls 7.32 4 16.47 9 27.45 15
25Data Warehoue & Mining - Spring 2014

26. Data Warehousing includes
Build Data Warehouse
Online Analysis/Analytical Processing (OLAP).
Presentation.
04/19/15
RDBMS
Flat File
Presentation
Cleaning ,Selection &
Integration
Warehouse & OLAP server
Client
26Data Warehoue & Mining - Spring 2014