SlideShare a Scribd company logo
DWH-Ahsan AbdullahDWH-Ahsan Abdullah
11
Data WarehousingData Warehousing
Lecture-1Lecture-1
Introduction and BackgroundIntroduction and Background
Virtual University of PakistanVirtual University of Pakistan
Ahsan Abdullah
Assoc. Prof. & Head
Center for Agro-Informatics Research
www.nu.edu.pk/cairindex.asp
FAST National University of Computers & Emerging Sciences, IslamabadFAST National University of Computers & Emerging Sciences, Islamabad
DWH-Ahsan Abdullah
2
Introduction and BackgroundIntroduction and Background
DWH-Ahsan Abdullah
3
Reference BooksReference Books
 W. H. Inmon,W. H. Inmon, Building the Data WarehouseBuilding the Data Warehouse
(Second Edition),(Second Edition), John Wiley & Sons Inc., NY.John Wiley & Sons Inc., NY.
 A. Abdullah, “A. Abdullah, “Data Warehousing for beginners:Data Warehousing for beginners:
Concepts & IssuesConcepts & Issues”” (First Edition).(First Edition).
 Paulraj Ponniah,Paulraj Ponniah, Data WarehousingData Warehousing
FundamentalsFundamentals,,
John Wiley & Sons Inc., NY.John Wiley & Sons Inc., NY.
DWH-Ahsan Abdullah
4
Additional MaterialAdditional Material
 Research PapersResearch Papers
 Magazine ArticlesMagazine Articles
DWH-Ahsan Abdullah
5
Summary of courseSummary of course
Topics (Total Lectures = 45)
1. Introduction & Background
2. De-normalization
3. On Line Analytical Processing (OLAP)
4. Dimensional modeling
5. Extract – Transform – Load (ETL)
6. Data Quality Management (DQM)
7. Need for speed (Parallelism, Join and Indexing techniques)
8. Data Mining
9. DWH Implementation steps
10. Complete implementation case study
11. Lab and tool usage
12. Others
DWH-Ahsan Abdullah
6
Summary of courseSummary of course
Topics
1. Introduction & Background
2. De-normalization
3. On Line Analytical Processing (OLAP)
4. Dimensional modeling
DWH-Ahsan Abdullah
7
Summary of courseSummary of course
Topics
5. Extract – Transform – Load (ETL)
6. Data Quality Management (DQM)
7. Need for speed (Parallelism, Join and
Indexing techniques)
8. Data Mining
9. DWH Implementation steps
DWH-Ahsan Abdullah
8
Summary of courseSummary of course
Topics
10. Complete implementation case study
11. Lab and tool usage
12. Others
DWH-Ahsan Abdullah
9
Semester ProjectSemester Project
Develop an application for an organizationDevelop an application for an organization
of your choice.of your choice.
A case study and coding based approachA case study and coding based approach
to be followed.to be followed.
Use 4GL or a high level programmingUse 4GL or a high level programming
language.language.
You MUST collect the necessary data andYou MUST collect the necessary data and
should have a first draft of the projectshould have a first draft of the project
description approved by the instructordescription approved by the instructor
BEFORE initiating on detailed work.BEFORE initiating on detailed work.
DWH-Ahsan Abdullah
10
Semester Project (Cont…)Semester Project (Cont…)
The project report to include, but is notThe project report to include, but is not
limited to, the following as documentation:limited to, the following as documentation:
 Narrative description of business and tables ofNarrative description of business and tables of
appropriate data.appropriate data.
 Descriptions of decisions to be supported byDescriptions of decisions to be supported by
information produced by system.information produced by system.
 Summary narrative of results produced.Summary narrative of results produced.
 Structure charts, dataflow diagrams and/or otherStructure charts, dataflow diagrams and/or other
diagrams to document the structure of the system.diagrams to document the structure of the system.
 Listings of computer models/programs utilized.Listings of computer models/programs utilized.
 Reports displaying results.Reports displaying results.
 Recommended decision from results.Recommended decision from results.
 User instructions.User instructions.
DWH-Ahsan Abdullah
11
 Develop an understanding of underlying RDBMSDevelop an understanding of underlying RDBMS
concepts.concepts.
 Apply these concepts to VLDB DSS environmentsApply these concepts to VLDB DSS environments
and understand where and why they break down?and understand where and why they break down?
 Expose the differences between RDBMS and DataExpose the differences between RDBMS and Data
Warehouse in the context of VLDB.Warehouse in the context of VLDB.
 Provide the basics of DSS tools such as OLAP,Provide the basics of DSS tools such as OLAP,
Data Mining and demonstrate their application.Data Mining and demonstrate their application.
 Demonstrate the application of DSS concepts andDemonstrate the application of DSS concepts and
limitations of the OLTP concepts through lablimitations of the OLTP concepts through lab
exercises.exercises.
Approach of the courseApproach of the course
DWH-Ahsan Abdullah
12
 The world is changing (actually changed),The world is changing (actually changed),
either change or be left behind.either change or be left behind.
 Missing the opportunities or going in theMissing the opportunities or going in the
wrong direction has prevented us fromwrong direction has prevented us from
growing.growing.
 What is the right direction?What is the right direction?
 Harnessing the data, in a knowledge drivenHarnessing the data, in a knowledge driven
economy.economy.
Why this course?Why this course?
DWH-Ahsan Abdullah
13
The needThe need
Knowledge is power, Intelligence
is absolute power!
“Drowning in data and starving
for information”
DWH-Ahsan Abdullah
14
The needThe need
DATA
INFORMATION
KNOWLEDGE
POWER
INTELLIGENCE
$$
DWH-Ahsan Abdullah
15
Historical overviewHistorical overview
1960
Master Files & Reports
1965
Lots of Master files!
1970
Direct Access Memory & DBMS
1975
Online high performance transaction processing 
DWH-Ahsan Abdullah
16
Historical overviewHistorical overview
1980
PCs and 4GL Technology (MIS/DSS)
1985 & 1990
Extract programs, extract processing,
The legacy system’s web


DWH-Ahsan Abdullah
17
Historical overview: Crisis of CredibilityHistorical overview: Crisis of Credibility




 
What is the financial health of our company?What is the financial health of our company?
-10%
+10%

??

More Related Content

What's hot

introduction to data warehousing and mining
 introduction to data warehousing and mining introduction to data warehousing and mining
introduction to data warehousing and mining
Rajesh Chandra
 
Data Warehousing And Data Mining Presentation Transcript
Data Warehousing And Data Mining   Presentation TranscriptData Warehousing And Data Mining   Presentation Transcript
Data Warehousing And Data Mining Presentation TranscriptSUBODH009
 
II-SDV 2014 Automated Relevancy Check of Patents and Scientific Literature (K...
II-SDV 2014 Automated Relevancy Check of Patents and Scientific Literature (K...II-SDV 2014 Automated Relevancy Check of Patents and Scientific Literature (K...
II-SDV 2014 Automated Relevancy Check of Patents and Scientific Literature (K...Dr. Haxel Consult
 
Data Warehouse By Piyush
Data Warehouse By PiyushData Warehouse By Piyush
Data Warehouse By Piyush
astronish
 
Technology Trend Analysis of R&D Strategy on iPS Cells
Technology Trend Analysis of R&D Strategy on iPS CellsTechnology Trend Analysis of R&D Strategy on iPS Cells
Technology Trend Analysis of R&D Strategy on iPS Cells
VALUENEX
 
Lecture2 big data life cycle
Lecture2 big data life cycleLecture2 big data life cycle
Lecture2 big data life cycle
hktripathy
 
Lecture 17
Lecture 17Lecture 17
Lecture 17
Shani729
 
Refinery Advisor
Refinery Advisor Refinery Advisor
Refinery Advisor
IBM Watson
 
Data mining
Data miningData mining
Data miningSilicon
 
Introduction to Data Warehousing
Introduction to Data WarehousingIntroduction to Data Warehousing
Introduction to Data WarehousingEdureka!
 
Lect 1 introduction
Lect 1 introductionLect 1 introduction
Lect 1 introduction
hktripathy
 
Big data analysis concepts and references
Big data analysis concepts and referencesBig data analysis concepts and references
Big data analysis concepts and references
Information Security Awareness Group
 
E business (e-commerce)
E business (e-commerce)E business (e-commerce)
E business (e-commerce)
Babasab Patil
 
Data Mining - The Big Picture!
Data Mining - The Big Picture!Data Mining - The Big Picture!
Data Mining - The Big Picture!
Khalid Salama
 
Data ware house
Data ware houseData ware house
Data ware house
Narayanreddy Sama
 
2013 OHSUG - Clinical Data Warehouse Implementation
2013 OHSUG - Clinical Data Warehouse Implementation2013 OHSUG - Clinical Data Warehouse Implementation
2013 OHSUG - Clinical Data Warehouse Implementation
Perficient
 
Datawarehouse olap olam
Datawarehouse olap olamDatawarehouse olap olam
Datawarehouse olap olam
Ravi Singh Shekhawat
 
Dw Concepts
Dw ConceptsDw Concepts
Dw Concepts
dataware
 
Lecture3 business intelligence
Lecture3 business intelligenceLecture3 business intelligence
Lecture3 business intelligence
hktripathy
 
Dataware housing
Dataware housingDataware housing
Dataware housingwork
 

What's hot (20)

introduction to data warehousing and mining
 introduction to data warehousing and mining introduction to data warehousing and mining
introduction to data warehousing and mining
 
Data Warehousing And Data Mining Presentation Transcript
Data Warehousing And Data Mining   Presentation TranscriptData Warehousing And Data Mining   Presentation Transcript
Data Warehousing And Data Mining Presentation Transcript
 
II-SDV 2014 Automated Relevancy Check of Patents and Scientific Literature (K...
II-SDV 2014 Automated Relevancy Check of Patents and Scientific Literature (K...II-SDV 2014 Automated Relevancy Check of Patents and Scientific Literature (K...
II-SDV 2014 Automated Relevancy Check of Patents and Scientific Literature (K...
 
Data Warehouse By Piyush
Data Warehouse By PiyushData Warehouse By Piyush
Data Warehouse By Piyush
 
Technology Trend Analysis of R&D Strategy on iPS Cells
Technology Trend Analysis of R&D Strategy on iPS CellsTechnology Trend Analysis of R&D Strategy on iPS Cells
Technology Trend Analysis of R&D Strategy on iPS Cells
 
Lecture2 big data life cycle
Lecture2 big data life cycleLecture2 big data life cycle
Lecture2 big data life cycle
 
Lecture 17
Lecture 17Lecture 17
Lecture 17
 
Refinery Advisor
Refinery Advisor Refinery Advisor
Refinery Advisor
 
Data mining
Data miningData mining
Data mining
 
Introduction to Data Warehousing
Introduction to Data WarehousingIntroduction to Data Warehousing
Introduction to Data Warehousing
 
Lect 1 introduction
Lect 1 introductionLect 1 introduction
Lect 1 introduction
 
Big data analysis concepts and references
Big data analysis concepts and referencesBig data analysis concepts and references
Big data analysis concepts and references
 
E business (e-commerce)
E business (e-commerce)E business (e-commerce)
E business (e-commerce)
 
Data Mining - The Big Picture!
Data Mining - The Big Picture!Data Mining - The Big Picture!
Data Mining - The Big Picture!
 
Data ware house
Data ware houseData ware house
Data ware house
 
2013 OHSUG - Clinical Data Warehouse Implementation
2013 OHSUG - Clinical Data Warehouse Implementation2013 OHSUG - Clinical Data Warehouse Implementation
2013 OHSUG - Clinical Data Warehouse Implementation
 
Datawarehouse olap olam
Datawarehouse olap olamDatawarehouse olap olam
Datawarehouse olap olam
 
Dw Concepts
Dw ConceptsDw Concepts
Dw Concepts
 
Lecture3 business intelligence
Lecture3 business intelligenceLecture3 business intelligence
Lecture3 business intelligence
 
Dataware housing
Dataware housingDataware housing
Dataware housing
 

Viewers also liked

Lecture 13
Lecture 13Lecture 13
Lecture 13
Shani729
 
DATA WAREHOUSING
DATA WAREHOUSINGDATA WAREHOUSING
DATA WAREHOUSING
King Julian
 
Lecture 16
Lecture 16Lecture 16
Lecture 16
Shani729
 
Introduction to Data Warehousing
Introduction to Data WarehousingIntroduction to Data Warehousing
Introduction to Data WarehousingEyad Manna
 
Data warehousing
Data warehousingData warehousing
Data warehousing
Shruti Dalela
 
Data Mining and Data Warehousing
Data Mining and Data WarehousingData Mining and Data Warehousing
Data Mining and Data WarehousingAswathy S Nair
 
Data mining & data warehousing (ppt)
Data mining & data warehousing (ppt)Data mining & data warehousing (ppt)
Data mining & data warehousing (ppt)
Harish Chand
 
Types of database
Types of databaseTypes of database
Types of database
faizan1712818
 
Planning Data Warehouse
Planning Data WarehousePlanning Data Warehouse
Planning Data Warehouse
Fahri Firdausillah
 
Data Warehousing Datamining Concepts
Data Warehousing Datamining ConceptsData Warehousing Datamining Concepts
Data Warehousing Datamining Concepts
raulmisir
 
Data Warehousing, Data Mining & Data Visualisation
Data Warehousing, Data Mining & Data VisualisationData Warehousing, Data Mining & Data Visualisation
Data Warehousing, Data Mining & Data Visualisation
Sunderland City Council
 
The Data Warehouse Lifecycle
The Data Warehouse LifecycleThe Data Warehouse Lifecycle
The Data Warehouse Lifecyclebartlowe
 
Data warehouse concepts
Data warehouse conceptsData warehouse concepts
Data warehouse concepts
obieefans
 
Types of databases
Types of databasesTypes of databases
Types of databasesPAQUIAAIZEL
 
DATA WAREHOUSING
DATA WAREHOUSINGDATA WAREHOUSING
DATA WAREHOUSING
Rishikese MR
 

Viewers also liked (20)

Lecture 13
Lecture 13Lecture 13
Lecture 13
 
DATA WAREHOUSING
DATA WAREHOUSINGDATA WAREHOUSING
DATA WAREHOUSING
 
Lecture 16
Lecture 16Lecture 16
Lecture 16
 
data warehousing
data warehousingdata warehousing
data warehousing
 
Introduction to Data Warehousing
Introduction to Data WarehousingIntroduction to Data Warehousing
Introduction to Data Warehousing
 
Database and types of databases
Database and types of databasesDatabase and types of databases
Database and types of databases
 
Data warehousing
Data warehousingData warehousing
Data warehousing
 
Data Mining and Data Warehousing
Data Mining and Data WarehousingData Mining and Data Warehousing
Data Mining and Data Warehousing
 
Data mining & data warehousing (ppt)
Data mining & data warehousing (ppt)Data mining & data warehousing (ppt)
Data mining & data warehousing (ppt)
 
planning & project management for DWH
planning & project management for DWHplanning & project management for DWH
planning & project management for DWH
 
Types of database
Types of databaseTypes of database
Types of database
 
Planning Data Warehouse
Planning Data WarehousePlanning Data Warehouse
Planning Data Warehouse
 
Data Warehousing Datamining Concepts
Data Warehousing Datamining ConceptsData Warehousing Datamining Concepts
Data Warehousing Datamining Concepts
 
Data Warehousing, Data Mining & Data Visualisation
Data Warehousing, Data Mining & Data VisualisationData Warehousing, Data Mining & Data Visualisation
Data Warehousing, Data Mining & Data Visualisation
 
The Data Warehouse Lifecycle
The Data Warehouse LifecycleThe Data Warehouse Lifecycle
The Data Warehouse Lifecycle
 
wi-fi ppt
wi-fi pptwi-fi ppt
wi-fi ppt
 
Data warehouse concepts
Data warehouse conceptsData warehouse concepts
Data warehouse concepts
 
Types dbms
Types dbmsTypes dbms
Types dbms
 
Types of databases
Types of databasesTypes of databases
Types of databases
 
DATA WAREHOUSING
DATA WAREHOUSINGDATA WAREHOUSING
DATA WAREHOUSING
 

Similar to Lecture 1

Lecture 1.ppt
Lecture 1.pptLecture 1.ppt
Lecture 1.ppt
AttaUrRahman78
 
Lecture 1.ppt
Lecture 1.pptLecture 1.ppt
Lecture 1.ppt
AttaUrRahman78
 
Lecture 10
Lecture 10Lecture 10
Lecture 10
Shani729
 
Lecture 4
Lecture 4Lecture 4
Lecture 4
Shani729
 
Lecture 32
Lecture 32Lecture 32
Lecture 32
Shani729
 
Sdmx at australian bureau of statistics
Sdmx at australian bureau of statisticsSdmx at australian bureau of statistics
Sdmx at australian bureau of statisticsVinicius Silva
 
Data warehouse
Data warehouseData warehouse
Data warehouse
Chakravarthi ch
 
Data warehouse
Data warehouseData warehouse
Data warehouse
krishna kumar singh
 
Introduction to Data Warehouse
Introduction to Data WarehouseIntroduction to Data Warehouse
Introduction to Data Warehouse
AnwarrChaudary
 
Big Data Discovery
Big Data DiscoveryBig Data Discovery
Big Data Discovery
Harald Erb
 
1° Sessione Oracle CRUI: Analytics Data Lab, the power of Big Data Investiga...
1° Sessione Oracle CRUI: Analytics Data Lab,  the power of Big Data Investiga...1° Sessione Oracle CRUI: Analytics Data Lab,  the power of Big Data Investiga...
1° Sessione Oracle CRUI: Analytics Data Lab, the power of Big Data Investiga...
Jürgen Ambrosi
 
A-Introduction-slides DataWarhouse.pptx
A-Introduction-slides DataWarhouse.pptxA-Introduction-slides DataWarhouse.pptx
A-Introduction-slides DataWarhouse.pptx
AnesElmouaddeb
 
“Publishing and Consuming Linked Data. (Lessons learnt when using LOD in an a...
“Publishing and Consuming Linked Data. (Lessons learnt when using LOD in an a...“Publishing and Consuming Linked Data. (Lessons learnt when using LOD in an a...
“Publishing and Consuming Linked Data. (Lessons learnt when using LOD in an a...
Marta Villegas
 
Database Essay
Database EssayDatabase Essay
Twist ways to study data sciences
Twist ways to study data sciencesTwist ways to study data sciences
Twist ways to study data sciences
Amang (Song-Kyoo) Kim, Ph.D.
 
Adaptive Semantic Data Management Techniques for Federations of Endpoints
Adaptive Semantic Data Management Techniques for Federations of EndpointsAdaptive Semantic Data Management Techniques for Federations of Endpoints
Adaptive Semantic Data Management Techniques for Federations of Endpoints
Maribel Acosta Deibe
 
Lecture 19
Lecture 19Lecture 19
Lecture 19
Shani729
 
Introduction to Data Warehousing
Introduction to Data WarehousingIntroduction to Data Warehousing
Introduction to Data Warehousing
Trevor Fox
 
How to Rapidly Configure Oracle Life Sciences Data Hub (LSH) to Support the M...
How to Rapidly Configure Oracle Life Sciences Data Hub (LSH) to Support the M...How to Rapidly Configure Oracle Life Sciences Data Hub (LSH) to Support the M...
How to Rapidly Configure Oracle Life Sciences Data Hub (LSH) to Support the M...Perficient
 
Transcript - Provenance and Social Science data
Transcript  - Provenance and Social Science dataTranscript  - Provenance and Social Science data
Transcript - Provenance and Social Science data
ARDC
 

Similar to Lecture 1 (20)

Lecture 1.ppt
Lecture 1.pptLecture 1.ppt
Lecture 1.ppt
 
Lecture 1.ppt
Lecture 1.pptLecture 1.ppt
Lecture 1.ppt
 
Lecture 10
Lecture 10Lecture 10
Lecture 10
 
Lecture 4
Lecture 4Lecture 4
Lecture 4
 
Lecture 32
Lecture 32Lecture 32
Lecture 32
 
Sdmx at australian bureau of statistics
Sdmx at australian bureau of statisticsSdmx at australian bureau of statistics
Sdmx at australian bureau of statistics
 
Data warehouse
Data warehouseData warehouse
Data warehouse
 
Data warehouse
Data warehouseData warehouse
Data warehouse
 
Introduction to Data Warehouse
Introduction to Data WarehouseIntroduction to Data Warehouse
Introduction to Data Warehouse
 
Big Data Discovery
Big Data DiscoveryBig Data Discovery
Big Data Discovery
 
1° Sessione Oracle CRUI: Analytics Data Lab, the power of Big Data Investiga...
1° Sessione Oracle CRUI: Analytics Data Lab,  the power of Big Data Investiga...1° Sessione Oracle CRUI: Analytics Data Lab,  the power of Big Data Investiga...
1° Sessione Oracle CRUI: Analytics Data Lab, the power of Big Data Investiga...
 
A-Introduction-slides DataWarhouse.pptx
A-Introduction-slides DataWarhouse.pptxA-Introduction-slides DataWarhouse.pptx
A-Introduction-slides DataWarhouse.pptx
 
“Publishing and Consuming Linked Data. (Lessons learnt when using LOD in an a...
“Publishing and Consuming Linked Data. (Lessons learnt when using LOD in an a...“Publishing and Consuming Linked Data. (Lessons learnt when using LOD in an a...
“Publishing and Consuming Linked Data. (Lessons learnt when using LOD in an a...
 
Database Essay
Database EssayDatabase Essay
Database Essay
 
Twist ways to study data sciences
Twist ways to study data sciencesTwist ways to study data sciences
Twist ways to study data sciences
 
Adaptive Semantic Data Management Techniques for Federations of Endpoints
Adaptive Semantic Data Management Techniques for Federations of EndpointsAdaptive Semantic Data Management Techniques for Federations of Endpoints
Adaptive Semantic Data Management Techniques for Federations of Endpoints
 
Lecture 19
Lecture 19Lecture 19
Lecture 19
 
Introduction to Data Warehousing
Introduction to Data WarehousingIntroduction to Data Warehousing
Introduction to Data Warehousing
 
How to Rapidly Configure Oracle Life Sciences Data Hub (LSH) to Support the M...
How to Rapidly Configure Oracle Life Sciences Data Hub (LSH) to Support the M...How to Rapidly Configure Oracle Life Sciences Data Hub (LSH) to Support the M...
How to Rapidly Configure Oracle Life Sciences Data Hub (LSH) to Support the M...
 
Transcript - Provenance and Social Science data
Transcript  - Provenance and Social Science dataTranscript  - Provenance and Social Science data
Transcript - Provenance and Social Science data
 

More from Shani729

Python tutorialfeb152012
Python tutorialfeb152012Python tutorialfeb152012
Python tutorialfeb152012
Shani729
 
Python tutorial
Python tutorialPython tutorial
Python tutorial
Shani729
 
Interaction design _beyond_human_computer_interaction
Interaction design _beyond_human_computer_interactionInteraction design _beyond_human_computer_interaction
Interaction design _beyond_human_computer_interaction
Shani729
 
Fm lecturer 13(final)
Fm lecturer 13(final)Fm lecturer 13(final)
Fm lecturer 13(final)
Shani729
 
Lecture slides week14-15
Lecture slides week14-15Lecture slides week14-15
Lecture slides week14-15
Shani729
 
Frequent itemset mining using pattern growth method
Frequent itemset mining using pattern growth methodFrequent itemset mining using pattern growth method
Frequent itemset mining using pattern growth method
Shani729
 
Dwh lecture slides-week15
Dwh lecture slides-week15Dwh lecture slides-week15
Dwh lecture slides-week15
Shani729
 
Dwh lecture slides-week10
Dwh lecture slides-week10Dwh lecture slides-week10
Dwh lecture slides-week10
Shani729
 
Dwh lecture slidesweek7&8
Dwh lecture slidesweek7&8Dwh lecture slidesweek7&8
Dwh lecture slidesweek7&8
Shani729
 
Dwh lecture slides-week5&6
Dwh lecture slides-week5&6Dwh lecture slides-week5&6
Dwh lecture slides-week5&6
Shani729
 
Dwh lecture slides-week3&4
Dwh lecture slides-week3&4Dwh lecture slides-week3&4
Dwh lecture slides-week3&4
Shani729
 
Dwh lecture slides-week2
Dwh lecture slides-week2Dwh lecture slides-week2
Dwh lecture slides-week2
Shani729
 
Dwh lecture slides-week1
Dwh lecture slides-week1Dwh lecture slides-week1
Dwh lecture slides-week1
Shani729
 
Dwh lecture slides-week 13
Dwh lecture slides-week 13Dwh lecture slides-week 13
Dwh lecture slides-week 13
Shani729
 
Dwh lecture slides-week 12&13
Dwh lecture slides-week 12&13Dwh lecture slides-week 12&13
Dwh lecture slides-week 12&13
Shani729
 
Data warehousing and mining furc
Data warehousing and mining furcData warehousing and mining furc
Data warehousing and mining furc
Shani729
 
Lecture 40
Lecture 40Lecture 40
Lecture 40
Shani729
 
Lecture 39
Lecture 39Lecture 39
Lecture 39
Shani729
 
Lecture 38
Lecture 38Lecture 38
Lecture 38
Shani729
 
Lecture 37
Lecture 37Lecture 37
Lecture 37
Shani729
 

More from Shani729 (20)

Python tutorialfeb152012
Python tutorialfeb152012Python tutorialfeb152012
Python tutorialfeb152012
 
Python tutorial
Python tutorialPython tutorial
Python tutorial
 
Interaction design _beyond_human_computer_interaction
Interaction design _beyond_human_computer_interactionInteraction design _beyond_human_computer_interaction
Interaction design _beyond_human_computer_interaction
 
Fm lecturer 13(final)
Fm lecturer 13(final)Fm lecturer 13(final)
Fm lecturer 13(final)
 
Lecture slides week14-15
Lecture slides week14-15Lecture slides week14-15
Lecture slides week14-15
 
Frequent itemset mining using pattern growth method
Frequent itemset mining using pattern growth methodFrequent itemset mining using pattern growth method
Frequent itemset mining using pattern growth method
 
Dwh lecture slides-week15
Dwh lecture slides-week15Dwh lecture slides-week15
Dwh lecture slides-week15
 
Dwh lecture slides-week10
Dwh lecture slides-week10Dwh lecture slides-week10
Dwh lecture slides-week10
 
Dwh lecture slidesweek7&8
Dwh lecture slidesweek7&8Dwh lecture slidesweek7&8
Dwh lecture slidesweek7&8
 
Dwh lecture slides-week5&6
Dwh lecture slides-week5&6Dwh lecture slides-week5&6
Dwh lecture slides-week5&6
 
Dwh lecture slides-week3&4
Dwh lecture slides-week3&4Dwh lecture slides-week3&4
Dwh lecture slides-week3&4
 
Dwh lecture slides-week2
Dwh lecture slides-week2Dwh lecture slides-week2
Dwh lecture slides-week2
 
Dwh lecture slides-week1
Dwh lecture slides-week1Dwh lecture slides-week1
Dwh lecture slides-week1
 
Dwh lecture slides-week 13
Dwh lecture slides-week 13Dwh lecture slides-week 13
Dwh lecture slides-week 13
 
Dwh lecture slides-week 12&13
Dwh lecture slides-week 12&13Dwh lecture slides-week 12&13
Dwh lecture slides-week 12&13
 
Data warehousing and mining furc
Data warehousing and mining furcData warehousing and mining furc
Data warehousing and mining furc
 
Lecture 40
Lecture 40Lecture 40
Lecture 40
 
Lecture 39
Lecture 39Lecture 39
Lecture 39
 
Lecture 38
Lecture 38Lecture 38
Lecture 38
 
Lecture 37
Lecture 37Lecture 37
Lecture 37
 

Recently uploaded

Standard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - NeometrixStandard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - Neometrix
Neometrix_Engineering_Pvt_Ltd
 
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Dr.Costas Sachpazis
 
Immunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary AttacksImmunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary Attacks
gerogepatton
 
Water Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation and Control Monthly - May 2024.pdfWater Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation & Control
 
TECHNICAL TRAINING MANUAL GENERAL FAMILIARIZATION COURSE
TECHNICAL TRAINING MANUAL   GENERAL FAMILIARIZATION COURSETECHNICAL TRAINING MANUAL   GENERAL FAMILIARIZATION COURSE
TECHNICAL TRAINING MANUAL GENERAL FAMILIARIZATION COURSE
DuvanRamosGarzon1
 
Halogenation process of chemical process industries
Halogenation process of chemical process industriesHalogenation process of chemical process industries
Halogenation process of chemical process industries
MuhammadTufail242431
 
LIGA(E)11111111111111111111111111111111111111111.ppt
LIGA(E)11111111111111111111111111111111111111111.pptLIGA(E)11111111111111111111111111111111111111111.ppt
LIGA(E)11111111111111111111111111111111111111111.ppt
ssuser9bd3ba
 
Democratizing Fuzzing at Scale by Abhishek Arya
Democratizing Fuzzing at Scale by Abhishek AryaDemocratizing Fuzzing at Scale by Abhishek Arya
Democratizing Fuzzing at Scale by Abhishek Arya
abh.arya
 
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang,  ICLR 2024, MLILAB, KAIST AI.pdfJ.Yang,  ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
MLILAB
 
Gen AI Study Jams _ For the GDSC Leads in India.pdf
Gen AI Study Jams _ For the GDSC Leads in India.pdfGen AI Study Jams _ For the GDSC Leads in India.pdf
Gen AI Study Jams _ For the GDSC Leads in India.pdf
gdsczhcet
 
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
MdTanvirMahtab2
 
The Benefits and Techniques of Trenchless Pipe Repair.pdf
The Benefits and Techniques of Trenchless Pipe Repair.pdfThe Benefits and Techniques of Trenchless Pipe Repair.pdf
The Benefits and Techniques of Trenchless Pipe Repair.pdf
Pipe Restoration Solutions
 
DESIGN A COTTON SEED SEPARATION MACHINE.docx
DESIGN A COTTON SEED SEPARATION MACHINE.docxDESIGN A COTTON SEED SEPARATION MACHINE.docx
DESIGN A COTTON SEED SEPARATION MACHINE.docx
FluxPrime1
 
Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024
Massimo Talia
 
ethical hacking-mobile hacking methods.ppt
ethical hacking-mobile hacking methods.pptethical hacking-mobile hacking methods.ppt
ethical hacking-mobile hacking methods.ppt
Jayaprasanna4
 
Railway Signalling Principles Edition 3.pdf
Railway Signalling Principles Edition 3.pdfRailway Signalling Principles Edition 3.pdf
Railway Signalling Principles Edition 3.pdf
TeeVichai
 
WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234
AafreenAbuthahir2
 
Student information management system project report ii.pdf
Student information management system project report ii.pdfStudent information management system project report ii.pdf
Student information management system project report ii.pdf
Kamal Acharya
 
Courier management system project report.pdf
Courier management system project report.pdfCourier management system project report.pdf
Courier management system project report.pdf
Kamal Acharya
 
Planning Of Procurement o different goods and services
Planning Of Procurement o different goods and servicesPlanning Of Procurement o different goods and services
Planning Of Procurement o different goods and services
JoytuBarua2
 

Recently uploaded (20)

Standard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - NeometrixStandard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - Neometrix
 
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
 
Immunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary AttacksImmunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary Attacks
 
Water Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation and Control Monthly - May 2024.pdfWater Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation and Control Monthly - May 2024.pdf
 
TECHNICAL TRAINING MANUAL GENERAL FAMILIARIZATION COURSE
TECHNICAL TRAINING MANUAL   GENERAL FAMILIARIZATION COURSETECHNICAL TRAINING MANUAL   GENERAL FAMILIARIZATION COURSE
TECHNICAL TRAINING MANUAL GENERAL FAMILIARIZATION COURSE
 
Halogenation process of chemical process industries
Halogenation process of chemical process industriesHalogenation process of chemical process industries
Halogenation process of chemical process industries
 
LIGA(E)11111111111111111111111111111111111111111.ppt
LIGA(E)11111111111111111111111111111111111111111.pptLIGA(E)11111111111111111111111111111111111111111.ppt
LIGA(E)11111111111111111111111111111111111111111.ppt
 
Democratizing Fuzzing at Scale by Abhishek Arya
Democratizing Fuzzing at Scale by Abhishek AryaDemocratizing Fuzzing at Scale by Abhishek Arya
Democratizing Fuzzing at Scale by Abhishek Arya
 
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang,  ICLR 2024, MLILAB, KAIST AI.pdfJ.Yang,  ICLR 2024, MLILAB, KAIST AI.pdf
J.Yang, ICLR 2024, MLILAB, KAIST AI.pdf
 
Gen AI Study Jams _ For the GDSC Leads in India.pdf
Gen AI Study Jams _ For the GDSC Leads in India.pdfGen AI Study Jams _ For the GDSC Leads in India.pdf
Gen AI Study Jams _ For the GDSC Leads in India.pdf
 
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
 
The Benefits and Techniques of Trenchless Pipe Repair.pdf
The Benefits and Techniques of Trenchless Pipe Repair.pdfThe Benefits and Techniques of Trenchless Pipe Repair.pdf
The Benefits and Techniques of Trenchless Pipe Repair.pdf
 
DESIGN A COTTON SEED SEPARATION MACHINE.docx
DESIGN A COTTON SEED SEPARATION MACHINE.docxDESIGN A COTTON SEED SEPARATION MACHINE.docx
DESIGN A COTTON SEED SEPARATION MACHINE.docx
 
Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024
 
ethical hacking-mobile hacking methods.ppt
ethical hacking-mobile hacking methods.pptethical hacking-mobile hacking methods.ppt
ethical hacking-mobile hacking methods.ppt
 
Railway Signalling Principles Edition 3.pdf
Railway Signalling Principles Edition 3.pdfRailway Signalling Principles Edition 3.pdf
Railway Signalling Principles Edition 3.pdf
 
WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234
 
Student information management system project report ii.pdf
Student information management system project report ii.pdfStudent information management system project report ii.pdf
Student information management system project report ii.pdf
 
Courier management system project report.pdf
Courier management system project report.pdfCourier management system project report.pdf
Courier management system project report.pdf
 
Planning Of Procurement o different goods and services
Planning Of Procurement o different goods and servicesPlanning Of Procurement o different goods and services
Planning Of Procurement o different goods and services
 

Lecture 1

  • 1. DWH-Ahsan AbdullahDWH-Ahsan Abdullah 11 Data WarehousingData Warehousing Lecture-1Lecture-1 Introduction and BackgroundIntroduction and Background Virtual University of PakistanVirtual University of Pakistan Ahsan Abdullah Assoc. Prof. & Head Center for Agro-Informatics Research www.nu.edu.pk/cairindex.asp FAST National University of Computers & Emerging Sciences, IslamabadFAST National University of Computers & Emerging Sciences, Islamabad
  • 2. DWH-Ahsan Abdullah 2 Introduction and BackgroundIntroduction and Background
  • 3. DWH-Ahsan Abdullah 3 Reference BooksReference Books  W. H. Inmon,W. H. Inmon, Building the Data WarehouseBuilding the Data Warehouse (Second Edition),(Second Edition), John Wiley & Sons Inc., NY.John Wiley & Sons Inc., NY.  A. Abdullah, “A. Abdullah, “Data Warehousing for beginners:Data Warehousing for beginners: Concepts & IssuesConcepts & Issues”” (First Edition).(First Edition).  Paulraj Ponniah,Paulraj Ponniah, Data WarehousingData Warehousing FundamentalsFundamentals,, John Wiley & Sons Inc., NY.John Wiley & Sons Inc., NY.
  • 4. DWH-Ahsan Abdullah 4 Additional MaterialAdditional Material  Research PapersResearch Papers  Magazine ArticlesMagazine Articles
  • 5. DWH-Ahsan Abdullah 5 Summary of courseSummary of course Topics (Total Lectures = 45) 1. Introduction & Background 2. De-normalization 3. On Line Analytical Processing (OLAP) 4. Dimensional modeling 5. Extract – Transform – Load (ETL) 6. Data Quality Management (DQM) 7. Need for speed (Parallelism, Join and Indexing techniques) 8. Data Mining 9. DWH Implementation steps 10. Complete implementation case study 11. Lab and tool usage 12. Others
  • 6. DWH-Ahsan Abdullah 6 Summary of courseSummary of course Topics 1. Introduction & Background 2. De-normalization 3. On Line Analytical Processing (OLAP) 4. Dimensional modeling
  • 7. DWH-Ahsan Abdullah 7 Summary of courseSummary of course Topics 5. Extract – Transform – Load (ETL) 6. Data Quality Management (DQM) 7. Need for speed (Parallelism, Join and Indexing techniques) 8. Data Mining 9. DWH Implementation steps
  • 8. DWH-Ahsan Abdullah 8 Summary of courseSummary of course Topics 10. Complete implementation case study 11. Lab and tool usage 12. Others
  • 9. DWH-Ahsan Abdullah 9 Semester ProjectSemester Project Develop an application for an organizationDevelop an application for an organization of your choice.of your choice. A case study and coding based approachA case study and coding based approach to be followed.to be followed. Use 4GL or a high level programmingUse 4GL or a high level programming language.language. You MUST collect the necessary data andYou MUST collect the necessary data and should have a first draft of the projectshould have a first draft of the project description approved by the instructordescription approved by the instructor BEFORE initiating on detailed work.BEFORE initiating on detailed work.
  • 10. DWH-Ahsan Abdullah 10 Semester Project (Cont…)Semester Project (Cont…) The project report to include, but is notThe project report to include, but is not limited to, the following as documentation:limited to, the following as documentation:  Narrative description of business and tables ofNarrative description of business and tables of appropriate data.appropriate data.  Descriptions of decisions to be supported byDescriptions of decisions to be supported by information produced by system.information produced by system.  Summary narrative of results produced.Summary narrative of results produced.  Structure charts, dataflow diagrams and/or otherStructure charts, dataflow diagrams and/or other diagrams to document the structure of the system.diagrams to document the structure of the system.  Listings of computer models/programs utilized.Listings of computer models/programs utilized.  Reports displaying results.Reports displaying results.  Recommended decision from results.Recommended decision from results.  User instructions.User instructions.
  • 11. DWH-Ahsan Abdullah 11  Develop an understanding of underlying RDBMSDevelop an understanding of underlying RDBMS concepts.concepts.  Apply these concepts to VLDB DSS environmentsApply these concepts to VLDB DSS environments and understand where and why they break down?and understand where and why they break down?  Expose the differences between RDBMS and DataExpose the differences between RDBMS and Data Warehouse in the context of VLDB.Warehouse in the context of VLDB.  Provide the basics of DSS tools such as OLAP,Provide the basics of DSS tools such as OLAP, Data Mining and demonstrate their application.Data Mining and demonstrate their application.  Demonstrate the application of DSS concepts andDemonstrate the application of DSS concepts and limitations of the OLTP concepts through lablimitations of the OLTP concepts through lab exercises.exercises. Approach of the courseApproach of the course
  • 12. DWH-Ahsan Abdullah 12  The world is changing (actually changed),The world is changing (actually changed), either change or be left behind.either change or be left behind.  Missing the opportunities or going in theMissing the opportunities or going in the wrong direction has prevented us fromwrong direction has prevented us from growing.growing.  What is the right direction?What is the right direction?  Harnessing the data, in a knowledge drivenHarnessing the data, in a knowledge driven economy.economy. Why this course?Why this course?
  • 13. DWH-Ahsan Abdullah 13 The needThe need Knowledge is power, Intelligence is absolute power! “Drowning in data and starving for information”
  • 14. DWH-Ahsan Abdullah 14 The needThe need DATA INFORMATION KNOWLEDGE POWER INTELLIGENCE $$
  • 15. DWH-Ahsan Abdullah 15 Historical overviewHistorical overview 1960 Master Files & Reports 1965 Lots of Master files! 1970 Direct Access Memory & DBMS 1975 Online high performance transaction processing 
  • 16. DWH-Ahsan Abdullah 16 Historical overviewHistorical overview 1980 PCs and 4GL Technology (MIS/DSS) 1985 & 1990 Extract programs, extract processing, The legacy system’s web  
  • 17. DWH-Ahsan Abdullah 17 Historical overview: Crisis of CredibilityHistorical overview: Crisis of Credibility       What is the financial health of our company?What is the financial health of our company? -10% +10%  ??

Editor's Notes

  1. <number>
  2. <number>
  3. <number>
  4. <number>
  5. <number>
  6. <number>
  7. <number>
  8. <number>