SlideShare a Scribd company logo
DEFINING DATA
WAREHOUSE
CONCEPTS AND
TERMINOLOGY
CHAPTER 3
DEFINITION OF A DATA WAREHOUSE
“ An enterprise structured repository of subject-oriented, time-variant, historical
data used for information retrieval and decision support. The data warehouse
stores atomic and summary data.”
Oracle Data Warehouse Method
DATA WAREHOUSE PROPERTIES
Data
Warehouse
Integrated
Time VariantNon Volatile
Subject
Oriented
SUBJECT-ORIENTED
Data is categorized and stored by business subject
rather than by application
Equity
Plans Shares Customer
financial
information
Savings
Insurance
Loans
OLTP Applications Data Warehouse Subject
INTEGRATED
OLTP Applications
Savings
Current
accounts
Loans
Data Warehouse
Data on a given subject is defined and stored once.
Customer
TIME-VARIANT
Data is stored as a series of snapshots, each
representing a period of time
Time Data
Jan-97 January
Feb-97 February
Mar-97 March
NONVOLATILE
Typically data in the data warehouse is not updated or delelted.
Insert
Update
Delete
Read Read
Operational Warehouse
Load
CHANGING DATA
Warehouse Database
First time load
Refresh
Refresh
Refresh
Operational
Database
DATA WAREHOUSE VERSUS OLTP
Property
Response
Time
Operations
Nature of Data
Data Organization
Size
Data Source
Activities
Operational
Sub seconds to
seconds
DML
30-60 days
Applications
Small to large
Operational, Internal
Processes
Data Warehouse
Seconds to hours
Snapshots over time
Subject, time
Large to very large
Operational, Internal,
External
Analysis
Primarily read only
USAGE CURVES
• Operational system is predictable
• Data warehouse
- Variable
- Random
USER EXPECTATIONS
• Control expectations
• Set achievable targets for query response
• Set SLAs
• Educate
• Growth and use is exponential
ENTERPRISEWIDE WAREHOUSE
• Large scale implementation
• Scope the entire business
• Data from all subject areas
• Developed incrementally
• Single source of enterprisewide data
• Single distribution point to dependent data marts
DATA WAREHOUSES VERSUS DATA
MARTS
Property Data Warehouse Data Mart
Scope Enterprise Department
Subject Multiple Single-subject, LOB
Data Source Many Few
Size(typical) 100 GB to>1 TB <100 GB
Implementation time Months to years Months
Data
Warehouse
Data
Warehouse
Data
Mart
Data
Mart
DEPENDENT DATA MART
Marketing
Sales
Finance
Human Resources
Marketing
Sales
Finance
Human Resources
MarketingMarketing
MarketingMarketing
MarketingMarketing
External Data
Data
Warehouse
Operational
Systems
Flat Files
Data Marts
INDEPENDENT DATA MART
Operational
Systems
External Data
Sale or Marketing
Flat Files
DATA WAREHOUSE TERMINOLOGY
• Operational data store (ODS)
Stores tactical data from production systems that are
subject-oriented and integrated to address
operational needs
• Metadata
MetadataMetadata
DATA WAREHOUSE TERMINOLOGY
Data
Integration
Enterprise data
warehouse
Business
area
warehouse
Source
data
Architecture
METHODOLGY
• Ensures a successful data warehouse
• Encourages incremental development
• Provides a staged approach to an enterprisewide warehouse
- Safe
- Manageable
- Proven
- Recommended
MODELING
• Warehouses differ from operational structures:
- Analytical requirements
- Subject orientation
• Data must map to subject oriented information:
- Identify business subjects
- Define relationships between subjects
- Name the attributes of each subject
• Modeling is iterative
• Modeling tools are available
EXTRACTION, TRANSFORMATION,
AND TRANSPORTATION
Purchase specialist tools, or develop programs
• Extraction-- select data using different methods
• Transformation--validate, clean, integrate, and
time stamp data
• Transportation--move data into the warehouse
OLTP Databases Staging File Warehouse Database
DATA MANAGEMENT
• Efficient database server and management tools for all aspects of data
management
• Imperatives
- Productive
- Flexible
- Robust
- Efficient
• Hardware, operating system and network management
DATA ACCESS AND REPORTING
• Tools that retrieve data for business analysis
• Imperatives
- Ease of use
- Intuitive
- Metadata
- Training
• More than one tool may be required
Warehouse
Database
Simple Queries
Forecasting
Drill-down
ORACLE WAREHOUSE COMPONENTS
Relational /
Multidimensional
Text, image Spatial
Web Audio
video
External
data
Operational
data
Relational
tools
OLAP
tools
Applications/Web
Any DataAny Source Any Access
ORACLE DATA MART SUITE
Data Modeling
Oracle Data Mart Designer
OLTP
Engines
OLTP
Databases
Data
Extraction
Oracle Data Mart
Builder
Ware-
housing
Engines
Data Mart
Database
SQL*Plus
Data
Management
Oracle Enterprise
Manager
Data Access
& Analysis
Discoverer &
Oracle Reports
DATA MART IMPLEMENTATION WITH THE
ORACLE DATA MART SUITE
• Oracle Enterprise Server
• Oracle Enterprise Manager
• Oracle Data Mart Builder
• Oracle Data Mart Designer
• Oracle Discoverer
• Oracle Web Application Server
• Oracle Reports
ORACLE WAREHOUSE BUILDER
ARCHITECTURE
Sources
Extraction
Facilities
• Loader
• Remotes SQL
• Gateways
- OLE-DB/ODBC
- Mainframe
- Specialized
• ERP Data
- SAP
- Peoplesoft
- Oracle
PL/SQL, Java
Transforms
Transform
Driver
PL/SQL, Java
Wrapper
External
Functions
Target
Tables
Filter
Transform
Oracle 8i
ORACLE BUSINESS INTELLIGENCE
TOOLS
Current Tactical Strategic
IS develops
user’s Views Business users Analysis
Oracle Reports Oracle Discover Oracle Express
THE TOOL FOR EACH TASK
Tool
Oracle
Reports
Oracle
Discover
Oracle
Express
Production
reporting
Ad hoc
query and
analysis
Advanced
analysis
Question
What were sales by
region last quarter?
What is driving the
increase in North
American sales?
Given the rapid increase
in Web sales, what will
total sales be for the rest
of the year?
Task
ORACLE WAREHOUSE SERVICES
Oracle
Education
Oracle
Consulting
Oracle Support Services
Customers
SUMMARY
This lesson covered the following topics:
• Identifying a common, broadly accepted definition of the
data warehouse
• Distinguishing the differences between OLTP systems and
analytical systems
• Defining some of the common data warehouse
terminology
• Identifying some of the elements and processes in a data
warehouse
• Identifying and positioning the Oracle Warehouse vision,
products, and services

More Related Content

What's hot

Role of MySQL in Data Analytics, Warehousing
Role of MySQL in Data Analytics, WarehousingRole of MySQL in Data Analytics, Warehousing
Role of MySQL in Data Analytics, Warehousing
Venu Anuganti
 
Oltp vs olap
Oltp vs olapOltp vs olap
Oltp vs olap
Mr. Fmhyudin
 
Building an Effective Data Warehouse Architecture
Building an Effective Data Warehouse ArchitectureBuilding an Effective Data Warehouse Architecture
Building an Effective Data Warehouse Architecture
James Serra
 
Building a Big Data Solution
Building a Big Data SolutionBuilding a Big Data Solution
Building a Big Data Solution
James Serra
 
Online analytical processing
Online analytical processingOnline analytical processing
Online analytical processing
Samraiz Tejani
 
Big Data in the Cloud with Azure Marketplace Images
Big Data in the Cloud with Azure Marketplace ImagesBig Data in the Cloud with Azure Marketplace Images
Big Data in the Cloud with Azure Marketplace Images
Mark Kromer
 
OLAP
OLAPOLAP
OLAP
Ashir Ali
 
Data warehouse introduction
Data warehouse introductionData warehouse introduction
Data warehouse introduction
Murli Jha
 
Modern data warehouse
Modern data warehouseModern data warehouse
Modern data warehouse
Stephen Alex
 
Olap, oltp and data mining
Olap, oltp and data miningOlap, oltp and data mining
Olap, oltp and data mining
zafrii
 
Strata+Hadoop World NY 2016 - Avinash Ramineni
Strata+Hadoop World NY 2016 - Avinash RamineniStrata+Hadoop World NY 2016 - Avinash Ramineni
Strata+Hadoop World NY 2016 - Avinash Ramineni
Avinash Ramineni
 
Data Architecture Brief Overview
Data Architecture Brief OverviewData Architecture Brief Overview
Data Architecture Brief Overview
Hal Kalechofsky
 
Big Data and Data Warehousing Together with Azure Synapse Analytics (SQLBits ...
Big Data and Data Warehousing Together with Azure Synapse Analytics (SQLBits ...Big Data and Data Warehousing Together with Azure Synapse Analytics (SQLBits ...
Big Data and Data Warehousing Together with Azure Synapse Analytics (SQLBits ...
Michael Rys
 
Database Camp 2016 @ United Nations, NYC - Bob Wiederhold, CEO, Couchbase
Database Camp 2016 @ United Nations, NYC - Bob Wiederhold, CEO, CouchbaseDatabase Camp 2016 @ United Nations, NYC - Bob Wiederhold, CEO, Couchbase
Database Camp 2016 @ United Nations, NYC - Bob Wiederhold, CEO, Couchbase
✔ Eric David Benari, PMP
 
Data Warehouse Design on Cloud ,A Big Data approach Part_One
Data Warehouse Design on Cloud ,A Big Data approach Part_OneData Warehouse Design on Cloud ,A Big Data approach Part_One
Data Warehouse Design on Cloud ,A Big Data approach Part_One
Panchaleswar Nayak
 
Data Lake Overview
Data Lake OverviewData Lake Overview
Data Lake Overview
James Serra
 
OLAP
OLAPOLAP
Presto – Today and Beyond – The Open Source SQL Engine for Querying all Data...
Presto – Today and Beyond – The Open Source SQL Engine for Querying all Data...Presto – Today and Beyond – The Open Source SQL Engine for Querying all Data...
Presto – Today and Beyond – The Open Source SQL Engine for Querying all Data...
Dipti Borkar
 
Talend Online Training
Talend Online TrainingTalend Online Training
Talend Online Training
QEdge Tech
 

What's hot (20)

Datawarehouse and OLAP
Datawarehouse and OLAPDatawarehouse and OLAP
Datawarehouse and OLAP
 
Role of MySQL in Data Analytics, Warehousing
Role of MySQL in Data Analytics, WarehousingRole of MySQL in Data Analytics, Warehousing
Role of MySQL in Data Analytics, Warehousing
 
Oltp vs olap
Oltp vs olapOltp vs olap
Oltp vs olap
 
Building an Effective Data Warehouse Architecture
Building an Effective Data Warehouse ArchitectureBuilding an Effective Data Warehouse Architecture
Building an Effective Data Warehouse Architecture
 
Building a Big Data Solution
Building a Big Data SolutionBuilding a Big Data Solution
Building a Big Data Solution
 
Online analytical processing
Online analytical processingOnline analytical processing
Online analytical processing
 
Big Data in the Cloud with Azure Marketplace Images
Big Data in the Cloud with Azure Marketplace ImagesBig Data in the Cloud with Azure Marketplace Images
Big Data in the Cloud with Azure Marketplace Images
 
OLAP
OLAPOLAP
OLAP
 
Data warehouse introduction
Data warehouse introductionData warehouse introduction
Data warehouse introduction
 
Modern data warehouse
Modern data warehouseModern data warehouse
Modern data warehouse
 
Olap, oltp and data mining
Olap, oltp and data miningOlap, oltp and data mining
Olap, oltp and data mining
 
Strata+Hadoop World NY 2016 - Avinash Ramineni
Strata+Hadoop World NY 2016 - Avinash RamineniStrata+Hadoop World NY 2016 - Avinash Ramineni
Strata+Hadoop World NY 2016 - Avinash Ramineni
 
Data Architecture Brief Overview
Data Architecture Brief OverviewData Architecture Brief Overview
Data Architecture Brief Overview
 
Big Data and Data Warehousing Together with Azure Synapse Analytics (SQLBits ...
Big Data and Data Warehousing Together with Azure Synapse Analytics (SQLBits ...Big Data and Data Warehousing Together with Azure Synapse Analytics (SQLBits ...
Big Data and Data Warehousing Together with Azure Synapse Analytics (SQLBits ...
 
Database Camp 2016 @ United Nations, NYC - Bob Wiederhold, CEO, Couchbase
Database Camp 2016 @ United Nations, NYC - Bob Wiederhold, CEO, CouchbaseDatabase Camp 2016 @ United Nations, NYC - Bob Wiederhold, CEO, Couchbase
Database Camp 2016 @ United Nations, NYC - Bob Wiederhold, CEO, Couchbase
 
Data Warehouse Design on Cloud ,A Big Data approach Part_One
Data Warehouse Design on Cloud ,A Big Data approach Part_OneData Warehouse Design on Cloud ,A Big Data approach Part_One
Data Warehouse Design on Cloud ,A Big Data approach Part_One
 
Data Lake Overview
Data Lake OverviewData Lake Overview
Data Lake Overview
 
OLAP
OLAPOLAP
OLAP
 
Presto – Today and Beyond – The Open Source SQL Engine for Querying all Data...
Presto – Today and Beyond – The Open Source SQL Engine for Querying all Data...Presto – Today and Beyond – The Open Source SQL Engine for Querying all Data...
Presto – Today and Beyond – The Open Source SQL Engine for Querying all Data...
 
Talend Online Training
Talend Online TrainingTalend Online Training
Talend Online Training
 

Viewers also liked

Бренд МФО - в чем сила?
Бренд МФО - в чем сила?Бренд МФО - в чем сила?
Бренд МФО - в чем сила?
FIN people group
 
Perlawanan sultan agung
Perlawanan sultan agungPerlawanan sultan agung
Perlawanan sultan agung
JESSICA DEWI FORTUNA BR. MARPAUNG
 
Pengantar pendidikan
Pengantar pendidikanPengantar pendidikan
Pengantar pendidikan
Sarli Arham
 
Brooks-George-Verizon-Rev5
Brooks-George-Verizon-Rev5Brooks-George-Verizon-Rev5
Brooks-George-Verizon-Rev5George Brooks
 
LINKPROFIT^: Mobile CPA
LINKPROFIT^: Mobile CPA LINKPROFIT^: Mobile CPA
LINKPROFIT^: Mobile CPA
Dmitry Yuhkhnevich
 
О МФО в двух словах
О МФО в двух словахО МФО в двух словах
О МФО в двух словах
Рустам Ильин
 
Kerangka Konseptual Kondisi Keuangan Pemerintah Daerah
Kerangka Konseptual Kondisi Keuangan Pemerintah DaerahKerangka Konseptual Kondisi Keuangan Pemerintah Daerah
Kerangka Konseptual Kondisi Keuangan Pemerintah Daerah
Basuki Rahmat
 
The Welcome Speech...Annual Day Celebration-2015 (Autosaved)
The Welcome Speech...Annual Day Celebration-2015 (Autosaved)The Welcome Speech...Annual Day Celebration-2015 (Autosaved)
The Welcome Speech...Annual Day Celebration-2015 (Autosaved)Pradip Banerjee
 
Localización y limites de America
Localización y limites de AmericaLocalización y limites de America
Localización y limites de America
mariamarrero07
 
Aligning Business Models And Technology Architectures Ore Dev Conferenc...
Aligning  Business  Models And  Technology  Architectures  Ore Dev  Conferenc...Aligning  Business  Models And  Technology  Architectures  Ore Dev  Conferenc...
Aligning Business Models And Technology Architectures Ore Dev Conferenc...
Enthiosys Inc
 
Relatorio mecanica
Relatorio mecanicaRelatorio mecanica
Relatorio mecanica
Alan Mendonça
 
State of the Word 2011
State of the Word 2011State of the Word 2011
State of the Word 2011
photomatt
 

Viewers also liked (12)

Бренд МФО - в чем сила?
Бренд МФО - в чем сила?Бренд МФО - в чем сила?
Бренд МФО - в чем сила?
 
Perlawanan sultan agung
Perlawanan sultan agungPerlawanan sultan agung
Perlawanan sultan agung
 
Pengantar pendidikan
Pengantar pendidikanPengantar pendidikan
Pengantar pendidikan
 
Brooks-George-Verizon-Rev5
Brooks-George-Verizon-Rev5Brooks-George-Verizon-Rev5
Brooks-George-Verizon-Rev5
 
LINKPROFIT^: Mobile CPA
LINKPROFIT^: Mobile CPA LINKPROFIT^: Mobile CPA
LINKPROFIT^: Mobile CPA
 
О МФО в двух словах
О МФО в двух словахО МФО в двух словах
О МФО в двух словах
 
Kerangka Konseptual Kondisi Keuangan Pemerintah Daerah
Kerangka Konseptual Kondisi Keuangan Pemerintah DaerahKerangka Konseptual Kondisi Keuangan Pemerintah Daerah
Kerangka Konseptual Kondisi Keuangan Pemerintah Daerah
 
The Welcome Speech...Annual Day Celebration-2015 (Autosaved)
The Welcome Speech...Annual Day Celebration-2015 (Autosaved)The Welcome Speech...Annual Day Celebration-2015 (Autosaved)
The Welcome Speech...Annual Day Celebration-2015 (Autosaved)
 
Localización y limites de America
Localización y limites de AmericaLocalización y limites de America
Localización y limites de America
 
Aligning Business Models And Technology Architectures Ore Dev Conferenc...
Aligning  Business  Models And  Technology  Architectures  Ore Dev  Conferenc...Aligning  Business  Models And  Technology  Architectures  Ore Dev  Conferenc...
Aligning Business Models And Technology Architectures Ore Dev Conferenc...
 
Relatorio mecanica
Relatorio mecanicaRelatorio mecanica
Relatorio mecanica
 
State of the Word 2011
State of the Word 2011State of the Word 2011
State of the Word 2011
 

Similar to Warehouse chapter3

Warehouse chapter3
Warehouse chapter3Warehouse chapter3
Warehouse chapter3
Lal Shaik
 
Unit 1
Unit 1Unit 1
Unit 1
DrSLokesh
 
DWH_PROJECT [Compatibility Mode]
DWH_PROJECT [Compatibility Mode]DWH_PROJECT [Compatibility Mode]
DWH_PROJECT [Compatibility Mode]vasanth kumar C
 
Data warehouse
Data warehouseData warehouse
Data warehouse
Saurab Dulal
 
Date warehousing concepts
Date warehousing conceptsDate warehousing concepts
Date warehousing conceptspcherukumalla
 
Data warehouse system and its concepts
Data warehouse system and its conceptsData warehouse system and its concepts
Data warehouse system and its concepts
Gaurav Garg
 
BI Chapter 03.pdf business business business business business business
BI Chapter 03.pdf business business business business business businessBI Chapter 03.pdf business business business business business business
BI Chapter 03.pdf business business business business business business
JawaherAlbaddawi
 
Module 1_Data Warehousing Fundamentals.pptx
Module 1_Data Warehousing Fundamentals.pptxModule 1_Data Warehousing Fundamentals.pptx
Module 1_Data Warehousing Fundamentals.pptx
nikshaikh786
 
Data ware housing - Introduction to data ware housing process.
Data ware housing - Introduction to data ware housing process.Data ware housing - Introduction to data ware housing process.
Data ware housing - Introduction to data ware housing process.
Vibrant Technologies & Computers
 
Datawarehousing & DSS
Datawarehousing & DSSDatawarehousing & DSS
Datawarehousing & DSS
Deepali Raut
 
What is a Data Warehouse and How Do I Test It?
What is a Data Warehouse and How Do I Test It?What is a Data Warehouse and How Do I Test It?
What is a Data Warehouse and How Do I Test It?
RTTS
 
DWH_Session_1.pptx
DWH_Session_1.pptxDWH_Session_1.pptx
DWH_Session_1.pptx
umashanker manthena
 
Dw Concepts
Dw ConceptsDw Concepts
Dw Concepts
dataware
 
Data Warehouse
Data WarehouseData Warehouse
Data Warehouse
AttaUrRahman78
 
kalyani.ppt
kalyani.pptkalyani.ppt
kalyani.ppt
ReyersonMax
 
Data Warehouse
Data WarehouseData Warehouse
Data Warehouse
AttaUrRahman78
 
kalyani.ppt
kalyani.pptkalyani.ppt
kalyani.ppt
GenrlUse1
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt
SumathiG8
 
Data warehouse
Data warehouse Data warehouse
Data warehouse
Yogendra Uikey
 
DATA WAREHOUSING
DATA WAREHOUSINGDATA WAREHOUSING
DATA WAREHOUSING
Rishikese MR
 

Similar to Warehouse chapter3 (20)

Warehouse chapter3
Warehouse chapter3Warehouse chapter3
Warehouse chapter3
 
Unit 1
Unit 1Unit 1
Unit 1
 
DWH_PROJECT [Compatibility Mode]
DWH_PROJECT [Compatibility Mode]DWH_PROJECT [Compatibility Mode]
DWH_PROJECT [Compatibility Mode]
 
Data warehouse
Data warehouseData warehouse
Data warehouse
 
Date warehousing concepts
Date warehousing conceptsDate warehousing concepts
Date warehousing concepts
 
Data warehouse system and its concepts
Data warehouse system and its conceptsData warehouse system and its concepts
Data warehouse system and its concepts
 
BI Chapter 03.pdf business business business business business business
BI Chapter 03.pdf business business business business business businessBI Chapter 03.pdf business business business business business business
BI Chapter 03.pdf business business business business business business
 
Module 1_Data Warehousing Fundamentals.pptx
Module 1_Data Warehousing Fundamentals.pptxModule 1_Data Warehousing Fundamentals.pptx
Module 1_Data Warehousing Fundamentals.pptx
 
Data ware housing - Introduction to data ware housing process.
Data ware housing - Introduction to data ware housing process.Data ware housing - Introduction to data ware housing process.
Data ware housing - Introduction to data ware housing process.
 
Datawarehousing & DSS
Datawarehousing & DSSDatawarehousing & DSS
Datawarehousing & DSS
 
What is a Data Warehouse and How Do I Test It?
What is a Data Warehouse and How Do I Test It?What is a Data Warehouse and How Do I Test It?
What is a Data Warehouse and How Do I Test It?
 
DWH_Session_1.pptx
DWH_Session_1.pptxDWH_Session_1.pptx
DWH_Session_1.pptx
 
Dw Concepts
Dw ConceptsDw Concepts
Dw Concepts
 
Data Warehouse
Data WarehouseData Warehouse
Data Warehouse
 
kalyani.ppt
kalyani.pptkalyani.ppt
kalyani.ppt
 
Data Warehouse
Data WarehouseData Warehouse
Data Warehouse
 
kalyani.ppt
kalyani.pptkalyani.ppt
kalyani.ppt
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt
 
Data warehouse
Data warehouse Data warehouse
Data warehouse
 
DATA WAREHOUSING
DATA WAREHOUSINGDATA WAREHOUSING
DATA WAREHOUSING
 

More from fika sweety

Query optimization and performance
Query optimization and performanceQuery optimization and performance
Query optimization and performance
fika sweety
 
Program design techniques
Program design techniquesProgram design techniques
Program design techniques
fika sweety
 
Plsql
PlsqlPlsql
Shift rotate
Shift rotateShift rotate
Shift rotate
fika sweety
 
Graphss
GraphssGraphss
Graphss
fika sweety
 
Modeling and simulation ch 1
Modeling and simulation ch 1Modeling and simulation ch 1
Modeling and simulation ch 1
fika sweety
 
Macros...presentation
Macros...presentationMacros...presentation
Macros...presentation
fika sweety
 
Pseudocode algorithim flowchart
Pseudocode algorithim flowchartPseudocode algorithim flowchart
Pseudocode algorithim flowchart
fika sweety
 
Diversity (HRM)
Diversity (HRM)Diversity (HRM)
Diversity (HRM)
fika sweety
 
Howtowriteamemo 090920105907-phpapp02
Howtowriteamemo 090920105907-phpapp02Howtowriteamemo 090920105907-phpapp02
Howtowriteamemo 090920105907-phpapp02
fika sweety
 
Coal presentationt
Coal presentationtCoal presentationt
Coal presentationt
fika sweety
 
1 Computer Architecture
1 Computer Architecture1 Computer Architecture
1 Computer Architecture
fika sweety
 
3 Pipelining
3 Pipelining3 Pipelining
3 Pipelining
fika sweety
 
19 primkruskal
19 primkruskal19 primkruskal
19 primkruskal
fika sweety
 
Storage memory
Storage memoryStorage memory
Storage memory
fika sweety
 
Quick sort
Quick sortQuick sort
Quick sort
fika sweety
 
Query optimization and performance
Query optimization and performanceQuery optimization and performance
Query optimization and performance
fika sweety
 
L2
L2L2
Master theorem
Master theoremMaster theorem
Master theorem
fika sweety
 
Database security copy
Database security   copyDatabase security   copy
Database security copy
fika sweety
 

More from fika sweety (20)

Query optimization and performance
Query optimization and performanceQuery optimization and performance
Query optimization and performance
 
Program design techniques
Program design techniquesProgram design techniques
Program design techniques
 
Plsql
PlsqlPlsql
Plsql
 
Shift rotate
Shift rotateShift rotate
Shift rotate
 
Graphss
GraphssGraphss
Graphss
 
Modeling and simulation ch 1
Modeling and simulation ch 1Modeling and simulation ch 1
Modeling and simulation ch 1
 
Macros...presentation
Macros...presentationMacros...presentation
Macros...presentation
 
Pseudocode algorithim flowchart
Pseudocode algorithim flowchartPseudocode algorithim flowchart
Pseudocode algorithim flowchart
 
Diversity (HRM)
Diversity (HRM)Diversity (HRM)
Diversity (HRM)
 
Howtowriteamemo 090920105907-phpapp02
Howtowriteamemo 090920105907-phpapp02Howtowriteamemo 090920105907-phpapp02
Howtowriteamemo 090920105907-phpapp02
 
Coal presentationt
Coal presentationtCoal presentationt
Coal presentationt
 
1 Computer Architecture
1 Computer Architecture1 Computer Architecture
1 Computer Architecture
 
3 Pipelining
3 Pipelining3 Pipelining
3 Pipelining
 
19 primkruskal
19 primkruskal19 primkruskal
19 primkruskal
 
Storage memory
Storage memoryStorage memory
Storage memory
 
Quick sort
Quick sortQuick sort
Quick sort
 
Query optimization and performance
Query optimization and performanceQuery optimization and performance
Query optimization and performance
 
L2
L2L2
L2
 
Master theorem
Master theoremMaster theorem
Master theorem
 
Database security copy
Database security   copyDatabase security   copy
Database security copy
 

Recently uploaded

ML for identifying fraud using open blockchain data.pptx
ML for identifying fraud using open blockchain data.pptxML for identifying fraud using open blockchain data.pptx
ML for identifying fraud using open blockchain data.pptx
Vijay Dialani, PhD
 
DESIGN A COTTON SEED SEPARATION MACHINE.docx
DESIGN A COTTON SEED SEPARATION MACHINE.docxDESIGN A COTTON SEED SEPARATION MACHINE.docx
DESIGN A COTTON SEED SEPARATION MACHINE.docx
FluxPrime1
 
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdfHybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
fxintegritypublishin
 
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
thanhdowork
 
Standard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - NeometrixStandard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - Neometrix
Neometrix_Engineering_Pvt_Ltd
 
The role of big data in decision making.
The role of big data in decision making.The role of big data in decision making.
The role of big data in decision making.
ankuprajapati0525
 
Runway Orientation Based on the Wind Rose Diagram.pptx
Runway Orientation Based on the Wind Rose Diagram.pptxRunway Orientation Based on the Wind Rose Diagram.pptx
Runway Orientation Based on the Wind Rose Diagram.pptx
SupreethSP4
 
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
H.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdfH.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdf
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
MLILAB
 
Gen AI Study Jams _ For the GDSC Leads in India.pdf
Gen AI Study Jams _ For the GDSC Leads in India.pdfGen AI Study Jams _ For the GDSC Leads in India.pdf
Gen AI Study Jams _ For the GDSC Leads in India.pdf
gdsczhcet
 
Water Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation and Control Monthly - May 2024.pdfWater Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation & Control
 
Hierarchical Digital Twin of a Naval Power System
Hierarchical Digital Twin of a Naval Power SystemHierarchical Digital Twin of a Naval Power System
Hierarchical Digital Twin of a Naval Power System
Kerry Sado
 
CME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional ElectiveCME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional Elective
karthi keyan
 
space technology lecture notes on satellite
space technology lecture notes on satellitespace technology lecture notes on satellite
space technology lecture notes on satellite
ongomchris
 
weather web application report.pdf
weather web application report.pdfweather web application report.pdf
weather web application report.pdf
Pratik Pawar
 
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
Amil Baba Dawood bangali
 
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&BDesign and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Sreedhar Chowdam
 
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxCFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
R&R Consult
 
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdfTop 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Teleport Manpower Consultant
 
MCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdfMCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdf
Osamah Alsalih
 
Railway Signalling Principles Edition 3.pdf
Railway Signalling Principles Edition 3.pdfRailway Signalling Principles Edition 3.pdf
Railway Signalling Principles Edition 3.pdf
TeeVichai
 

Recently uploaded (20)

ML for identifying fraud using open blockchain data.pptx
ML for identifying fraud using open blockchain data.pptxML for identifying fraud using open blockchain data.pptx
ML for identifying fraud using open blockchain data.pptx
 
DESIGN A COTTON SEED SEPARATION MACHINE.docx
DESIGN A COTTON SEED SEPARATION MACHINE.docxDESIGN A COTTON SEED SEPARATION MACHINE.docx
DESIGN A COTTON SEED SEPARATION MACHINE.docx
 
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdfHybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdf
 
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
 
Standard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - NeometrixStandard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - Neometrix
 
The role of big data in decision making.
The role of big data in decision making.The role of big data in decision making.
The role of big data in decision making.
 
Runway Orientation Based on the Wind Rose Diagram.pptx
Runway Orientation Based on the Wind Rose Diagram.pptxRunway Orientation Based on the Wind Rose Diagram.pptx
Runway Orientation Based on the Wind Rose Diagram.pptx
 
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
H.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdfH.Seo,  ICLR 2024, MLILAB,  KAIST AI.pdf
H.Seo, ICLR 2024, MLILAB, KAIST AI.pdf
 
Gen AI Study Jams _ For the GDSC Leads in India.pdf
Gen AI Study Jams _ For the GDSC Leads in India.pdfGen AI Study Jams _ For the GDSC Leads in India.pdf
Gen AI Study Jams _ For the GDSC Leads in India.pdf
 
Water Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation and Control Monthly - May 2024.pdfWater Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation and Control Monthly - May 2024.pdf
 
Hierarchical Digital Twin of a Naval Power System
Hierarchical Digital Twin of a Naval Power SystemHierarchical Digital Twin of a Naval Power System
Hierarchical Digital Twin of a Naval Power System
 
CME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional ElectiveCME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional Elective
 
space technology lecture notes on satellite
space technology lecture notes on satellitespace technology lecture notes on satellite
space technology lecture notes on satellite
 
weather web application report.pdf
weather web application report.pdfweather web application report.pdf
weather web application report.pdf
 
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
 
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&BDesign and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
 
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxCFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
 
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdfTop 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
 
MCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdfMCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdf
 
Railway Signalling Principles Edition 3.pdf
Railway Signalling Principles Edition 3.pdfRailway Signalling Principles Edition 3.pdf
Railway Signalling Principles Edition 3.pdf
 

Warehouse chapter3

  • 2. DEFINITION OF A DATA WAREHOUSE “ An enterprise structured repository of subject-oriented, time-variant, historical data used for information retrieval and decision support. The data warehouse stores atomic and summary data.” Oracle Data Warehouse Method
  • 3. DATA WAREHOUSE PROPERTIES Data Warehouse Integrated Time VariantNon Volatile Subject Oriented
  • 4. SUBJECT-ORIENTED Data is categorized and stored by business subject rather than by application Equity Plans Shares Customer financial information Savings Insurance Loans OLTP Applications Data Warehouse Subject
  • 5. INTEGRATED OLTP Applications Savings Current accounts Loans Data Warehouse Data on a given subject is defined and stored once. Customer
  • 6. TIME-VARIANT Data is stored as a series of snapshots, each representing a period of time Time Data Jan-97 January Feb-97 February Mar-97 March
  • 7. NONVOLATILE Typically data in the data warehouse is not updated or delelted. Insert Update Delete Read Read Operational Warehouse Load
  • 8. CHANGING DATA Warehouse Database First time load Refresh Refresh Refresh Operational Database
  • 9. DATA WAREHOUSE VERSUS OLTP Property Response Time Operations Nature of Data Data Organization Size Data Source Activities Operational Sub seconds to seconds DML 30-60 days Applications Small to large Operational, Internal Processes Data Warehouse Seconds to hours Snapshots over time Subject, time Large to very large Operational, Internal, External Analysis Primarily read only
  • 10. USAGE CURVES • Operational system is predictable • Data warehouse - Variable - Random
  • 11. USER EXPECTATIONS • Control expectations • Set achievable targets for query response • Set SLAs • Educate • Growth and use is exponential
  • 12. ENTERPRISEWIDE WAREHOUSE • Large scale implementation • Scope the entire business • Data from all subject areas • Developed incrementally • Single source of enterprisewide data • Single distribution point to dependent data marts
  • 13. DATA WAREHOUSES VERSUS DATA MARTS Property Data Warehouse Data Mart Scope Enterprise Department Subject Multiple Single-subject, LOB Data Source Many Few Size(typical) 100 GB to>1 TB <100 GB Implementation time Months to years Months Data Warehouse Data Warehouse Data Mart Data Mart
  • 14. DEPENDENT DATA MART Marketing Sales Finance Human Resources Marketing Sales Finance Human Resources MarketingMarketing MarketingMarketing MarketingMarketing External Data Data Warehouse Operational Systems Flat Files Data Marts
  • 15. INDEPENDENT DATA MART Operational Systems External Data Sale or Marketing Flat Files
  • 16. DATA WAREHOUSE TERMINOLOGY • Operational data store (ODS) Stores tactical data from production systems that are subject-oriented and integrated to address operational needs • Metadata MetadataMetadata
  • 17. DATA WAREHOUSE TERMINOLOGY Data Integration Enterprise data warehouse Business area warehouse Source data Architecture
  • 18. METHODOLGY • Ensures a successful data warehouse • Encourages incremental development • Provides a staged approach to an enterprisewide warehouse - Safe - Manageable - Proven - Recommended
  • 19. MODELING • Warehouses differ from operational structures: - Analytical requirements - Subject orientation • Data must map to subject oriented information: - Identify business subjects - Define relationships between subjects - Name the attributes of each subject • Modeling is iterative • Modeling tools are available
  • 20. EXTRACTION, TRANSFORMATION, AND TRANSPORTATION Purchase specialist tools, or develop programs • Extraction-- select data using different methods • Transformation--validate, clean, integrate, and time stamp data • Transportation--move data into the warehouse OLTP Databases Staging File Warehouse Database
  • 21. DATA MANAGEMENT • Efficient database server and management tools for all aspects of data management • Imperatives - Productive - Flexible - Robust - Efficient • Hardware, operating system and network management
  • 22. DATA ACCESS AND REPORTING • Tools that retrieve data for business analysis • Imperatives - Ease of use - Intuitive - Metadata - Training • More than one tool may be required Warehouse Database Simple Queries Forecasting Drill-down
  • 23. ORACLE WAREHOUSE COMPONENTS Relational / Multidimensional Text, image Spatial Web Audio video External data Operational data Relational tools OLAP tools Applications/Web Any DataAny Source Any Access
  • 24. ORACLE DATA MART SUITE Data Modeling Oracle Data Mart Designer OLTP Engines OLTP Databases Data Extraction Oracle Data Mart Builder Ware- housing Engines Data Mart Database SQL*Plus Data Management Oracle Enterprise Manager Data Access & Analysis Discoverer & Oracle Reports
  • 25. DATA MART IMPLEMENTATION WITH THE ORACLE DATA MART SUITE • Oracle Enterprise Server • Oracle Enterprise Manager • Oracle Data Mart Builder • Oracle Data Mart Designer • Oracle Discoverer • Oracle Web Application Server • Oracle Reports
  • 26. ORACLE WAREHOUSE BUILDER ARCHITECTURE Sources Extraction Facilities • Loader • Remotes SQL • Gateways - OLE-DB/ODBC - Mainframe - Specialized • ERP Data - SAP - Peoplesoft - Oracle PL/SQL, Java Transforms Transform Driver PL/SQL, Java Wrapper External Functions Target Tables Filter Transform Oracle 8i
  • 27. ORACLE BUSINESS INTELLIGENCE TOOLS Current Tactical Strategic IS develops user’s Views Business users Analysis Oracle Reports Oracle Discover Oracle Express
  • 28. THE TOOL FOR EACH TASK Tool Oracle Reports Oracle Discover Oracle Express Production reporting Ad hoc query and analysis Advanced analysis Question What were sales by region last quarter? What is driving the increase in North American sales? Given the rapid increase in Web sales, what will total sales be for the rest of the year? Task
  • 30. SUMMARY This lesson covered the following topics: • Identifying a common, broadly accepted definition of the data warehouse • Distinguishing the differences between OLTP systems and analytical systems • Defining some of the common data warehouse terminology • Identifying some of the elements and processes in a data warehouse • Identifying and positioning the Oracle Warehouse vision, products, and services