SlideShare a Scribd company logo
1 of 33
Role of Metadata
Why Metadata
 Before touches the keyboard by the
prominent(superlative) users.
 Several questions come to their mind.
What are various data in the data
warehouse?
Is there information about unit sale and
costs by product?
How old is the data in the warehouse.
When was the last time fresh data was
brought in?
Are there any summaries by month and
product?
Why Meta data contd.,
 These questions and several more
information are very valid and pertinent.
 What are answers? Where are the
answers? Can ur user see the answers?
How easy to get the answers?
What is Meta data?
 Metadata in a data warehouse contains
the answer to questions about the data
in the data warehouse.
 Keep the answer in a place called the
metadata repository.
Different definitions for
metadata
 Data about the data.
 Table of contents for the data.
 Catalog for the data.
 Data warehouse roadmap.
 Data warehouse directory.
 Tongs to handle the data.
 The nerve center.
So, what exactly is metadata
 It tells u more.
 It gives more than the explanation of the
semantics and the syntax.
 Describes all the pertinent(relevant)
aspect of the data in the data
warehouse.
 Pertinent to whom?
 The answer is – primarily to the user
and also developer and even project
team.
Meta data
Why it is important?
 Metadata is necessary for using,
building and administering your data
warehouse.
For using the data warehouse
 Without the metadata support, user
cannot get an information every time
they needed(user create their own ad
hoc report).
 Today data warehouses are much larger
in size, wide in scope.
 User critically need metadata.
For building the data
warehouse(extraction team)
 Need to know the structure and data
content in the data warehouse.
 Mapping and data transformations.
 Logical structure of data warehouse
database.
For administering the data
warehouse
 Impossible to administer the data
warehouse(size)
 Large no of questions and queries.
 Cannot administer without answers for
these questions.
 Metadata must address these issues.
List of questions relating to
data warehouse
Who needs metadata?
 Without metadata, Datawarehouse is
like such a filling cabinet without
information.
 Go through the image column(it address
the our question)
Like a nerve center
 Metadata placed in a key position and
enables communication among various
processes.
Why metadata is essential for
IT
 Development and deployment of data
warehouse is joint effort between users
and IT staff.
 Technical issue-IT primarily responsible
design and ongoing administration.
 Metadata essential for IT
 beginning with the data extraction and
ending with information delivery.
 It drives and record the each processes.
Summary list of process in which
metadata is significant for IT
 Data extraction
 Data transformation
 Data scrubbing
 Data staging
 Data refreshment
 Database design
 Query report and design
Automation of DWH tasks
Types by Functional Area
 Classify and group in various way-some
by usage and who use it
 Administrative/End-user/Optimization
 Technical/Business
 Development/usage
 In the data mart/At the workstation
 Bank room/front room
 Internal/External
Functional Areas
 Data Acquisition
 Data stroage
 Information delivery
Data Acquisition
 DWH process related to following
functions.
Data extraction
Data transformation
Data cleaning
Data integration
Data staging
Data aquisition
Data stroage
 Data loading
 Data archiving
 Data management
 Use metadata in this area for full data
refresh and load.
Information Delivery
 Report generating
 Query processing
 Complex analysis
Mostly this are meant for end-user.
Metadata recorded in processes of other
two areas.
It also record OLAP-the developer and
administrators are involved in this
processes.
Business METADATA
 It connect business with DWH.
 Business users need more than other
users.
 Business metadata is like a roadmap.
 Tout guide-managers and analysis.
 Must describe the contents in plain
language giving information in business
teerms.
 Example
The name of data tables (or) individual
element must not be cryptic.
The data item name-calc_pr_sle.
You need to rename this as calculated-prior-
month-sale
Business metadata Contd.,
 Much less structured than technical
metadata.
 Textual documents, spreadsheets, and
even business rules and policies not
written down completely.
Examples of Business
Metadata who Benefits?
 Primarily benefits end-users.
Managers
Business analysis
Power users
Regular users
Casual users
Senior managers/ junior managers
Technical Metadata
 IT staff- Development and
Administration of the data warehouse.
 Who Benefits?
Project manager
Data warehouse administrator
Metadata manager
Database administrator
Business analyst
Data quality analyst

More Related Content

What's hot

Data warehouse architecture
Data warehouse architectureData warehouse architecture
Data warehouse architecture
pcherukumalla
 
Introduction to data warehousing
Introduction to data warehousing   Introduction to data warehousing
Introduction to data warehousing
Girish Dhareshwar
 
Introduction to Data Warehousing
Introduction to Data WarehousingIntroduction to Data Warehousing
Introduction to Data Warehousing
Eyad Manna
 
Components of a Data-Warehouse
Components of a Data-WarehouseComponents of a Data-Warehouse
Components of a Data-Warehouse
Abdul Aslam
 
Hadoop Tutorial For Beginners | Apache Hadoop Tutorial For Beginners | Hadoop...
Hadoop Tutorial For Beginners | Apache Hadoop Tutorial For Beginners | Hadoop...Hadoop Tutorial For Beginners | Apache Hadoop Tutorial For Beginners | Hadoop...
Hadoop Tutorial For Beginners | Apache Hadoop Tutorial For Beginners | Hadoop...
Simplilearn
 

What's hot (20)

Ppt
PptPpt
Ppt
 
Data warehouse architecture
Data warehouse architectureData warehouse architecture
Data warehouse architecture
 
NoSql
NoSqlNoSql
NoSql
 
Lecture1 introduction to big data
Lecture1 introduction to big dataLecture1 introduction to big data
Lecture1 introduction to big data
 
Data Warehouse
Data Warehouse Data Warehouse
Data Warehouse
 
Introduction to data warehousing
Introduction to data warehousing   Introduction to data warehousing
Introduction to data warehousing
 
Dimensional Modeling
Dimensional ModelingDimensional Modeling
Dimensional Modeling
 
Data Warehousing
Data WarehousingData Warehousing
Data Warehousing
 
Introduction to ETL and Data Integration
Introduction to ETL and Data IntegrationIntroduction to ETL and Data Integration
Introduction to ETL and Data Integration
 
Introduction to Data Warehousing
Introduction to Data WarehousingIntroduction to Data Warehousing
Introduction to Data Warehousing
 
Data Modeling PPT
Data Modeling PPTData Modeling PPT
Data Modeling PPT
 
Map Reduce
Map ReduceMap Reduce
Map Reduce
 
Data warehouse
Data warehouseData warehouse
Data warehouse
 
Big data lecture notes
Big data lecture notesBig data lecture notes
Big data lecture notes
 
Components of a Data-Warehouse
Components of a Data-WarehouseComponents of a Data-Warehouse
Components of a Data-Warehouse
 
Hadoop Tutorial For Beginners | Apache Hadoop Tutorial For Beginners | Hadoop...
Hadoop Tutorial For Beginners | Apache Hadoop Tutorial For Beginners | Hadoop...Hadoop Tutorial For Beginners | Apache Hadoop Tutorial For Beginners | Hadoop...
Hadoop Tutorial For Beginners | Apache Hadoop Tutorial For Beginners | Hadoop...
 
DATA WAREHOUSING AND DATA MINING
DATA WAREHOUSING AND DATA MININGDATA WAREHOUSING AND DATA MINING
DATA WAREHOUSING AND DATA MINING
 
Data warehousing
Data warehousingData warehousing
Data warehousing
 
Lecture6 introduction to data streams
Lecture6 introduction to data streamsLecture6 introduction to data streams
Lecture6 introduction to data streams
 
Data Warehouse 101
Data Warehouse 101Data Warehouse 101
Data Warehouse 101
 

Similar to Metadata in data warehouse

Dataware housing
Dataware housingDataware housing
Dataware housing
work
 
Datawarehousing
DatawarehousingDatawarehousing
Datawarehousing
work
 
Datawarehousing
DatawarehousingDatawarehousing
Datawarehousing
sumit621
 
Report for internship
Report for internshipReport for internship
Report for internship
Salman Khan
 
Data warehouse
Data warehouseData warehouse
Data warehouse
MR Z
 

Similar to Metadata in data warehouse (20)

Metadata
MetadataMetadata
Metadata
 
Dataware housing
Dataware housingDataware housing
Dataware housing
 
dw_concepts_2_day_course.ppt
dw_concepts_2_day_course.pptdw_concepts_2_day_course.ppt
dw_concepts_2_day_course.ppt
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt
 
Datawarehousing
DatawarehousingDatawarehousing
Datawarehousing
 
Datawarehousing
DatawarehousingDatawarehousing
Datawarehousing
 
E05WAREH1.PPT
E05WAREH1.PPTE05WAREH1.PPT
E05WAREH1.PPT
 
Planning Data Warehouse
Planning Data WarehousePlanning Data Warehouse
Planning Data Warehouse
 
DATA WAREHOUSING
DATA WAREHOUSINGDATA WAREHOUSING
DATA WAREHOUSING
 
Report for internship
Report for internshipReport for internship
Report for internship
 
20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt20IT501_DWDM_PPT_Unit_I.ppt
20IT501_DWDM_PPT_Unit_I.ppt
 
Introduction to Data Warehousing
Introduction to Data WarehousingIntroduction to Data Warehousing
Introduction to Data Warehousing
 
Data warehouse
Data warehouseData warehouse
Data warehouse
 
Presentation
PresentationPresentation
Presentation
 
Datawarehousing & DSS
Datawarehousing & DSSDatawarehousing & DSS
Datawarehousing & DSS
 
3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt3._DWH_Architecture__Components.ppt
3._DWH_Architecture__Components.ppt
 
Data warehousing
Data warehousingData warehousing
Data warehousing
 
Metadata Repositories in Health Care - Master Data Management Approach to Met...
Metadata Repositories in Health Care - Master Data Management Approach to Met...Metadata Repositories in Health Care - Master Data Management Approach to Met...
Metadata Repositories in Health Care - Master Data Management Approach to Met...
 
Dw & etl concepts
Dw & etl conceptsDw & etl concepts
Dw & etl concepts
 

More from Siddique Ibrahim

More from Siddique Ibrahim (20)

List in Python
List in PythonList in Python
List in Python
 
Python Control structures
Python Control structuresPython Control structures
Python Control structures
 
Python programming introduction
Python programming introductionPython programming introduction
Python programming introduction
 
Data mining basic fundamentals
Data mining basic fundamentalsData mining basic fundamentals
Data mining basic fundamentals
 
Basic networking
Basic networkingBasic networking
Basic networking
 
Virtualization Concepts
Virtualization ConceptsVirtualization Concepts
Virtualization Concepts
 
Networking devices(siddique)
Networking devices(siddique)Networking devices(siddique)
Networking devices(siddique)
 
Osi model 7 Layers
Osi model 7 LayersOsi model 7 Layers
Osi model 7 Layers
 
Mysql grand
Mysql grandMysql grand
Mysql grand
 
Getting started into mySQL
Getting started into mySQLGetting started into mySQL
Getting started into mySQL
 
pipelining
pipeliningpipelining
pipelining
 
Micro programmed control
Micro programmed controlMicro programmed control
Micro programmed control
 
Hardwired control
Hardwired controlHardwired control
Hardwired control
 
interface
interfaceinterface
interface
 
Interrupt
InterruptInterrupt
Interrupt
 
Interrupt
InterruptInterrupt
Interrupt
 
DMA
DMADMA
DMA
 
Io devies
Io deviesIo devies
Io devies
 
Stack & queue
Stack & queueStack & queue
Stack & queue
 
Data extraction, transformation, and loading
Data extraction, transformation, and loadingData extraction, transformation, and loading
Data extraction, transformation, and loading
 

Recently uploaded

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Recently uploaded (20)

GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 

Metadata in data warehouse

  • 2. Why Metadata  Before touches the keyboard by the prominent(superlative) users.  Several questions come to their mind. What are various data in the data warehouse? Is there information about unit sale and costs by product? How old is the data in the warehouse. When was the last time fresh data was brought in? Are there any summaries by month and product?
  • 3. Why Meta data contd.,  These questions and several more information are very valid and pertinent.  What are answers? Where are the answers? Can ur user see the answers? How easy to get the answers?
  • 4. What is Meta data?  Metadata in a data warehouse contains the answer to questions about the data in the data warehouse.  Keep the answer in a place called the metadata repository.
  • 5. Different definitions for metadata  Data about the data.  Table of contents for the data.  Catalog for the data.  Data warehouse roadmap.  Data warehouse directory.  Tongs to handle the data.  The nerve center.
  • 6. So, what exactly is metadata  It tells u more.  It gives more than the explanation of the semantics and the syntax.  Describes all the pertinent(relevant) aspect of the data in the data warehouse.  Pertinent to whom?  The answer is – primarily to the user and also developer and even project team.
  • 8. Why it is important?  Metadata is necessary for using, building and administering your data warehouse.
  • 9. For using the data warehouse  Without the metadata support, user cannot get an information every time they needed(user create their own ad hoc report).  Today data warehouses are much larger in size, wide in scope.  User critically need metadata.
  • 10. For building the data warehouse(extraction team)  Need to know the structure and data content in the data warehouse.  Mapping and data transformations.  Logical structure of data warehouse database.
  • 11. For administering the data warehouse  Impossible to administer the data warehouse(size)  Large no of questions and queries.  Cannot administer without answers for these questions.  Metadata must address these issues.
  • 12. List of questions relating to data warehouse
  • 13. Who needs metadata?  Without metadata, Datawarehouse is like such a filling cabinet without information.  Go through the image column(it address the our question)
  • 14.
  • 15. Like a nerve center  Metadata placed in a key position and enables communication among various processes.
  • 16.
  • 17. Why metadata is essential for IT  Development and deployment of data warehouse is joint effort between users and IT staff.  Technical issue-IT primarily responsible design and ongoing administration.  Metadata essential for IT  beginning with the data extraction and ending with information delivery.  It drives and record the each processes.
  • 18.
  • 19. Summary list of process in which metadata is significant for IT  Data extraction  Data transformation  Data scrubbing  Data staging  Data refreshment  Database design  Query report and design
  • 21. Types by Functional Area  Classify and group in various way-some by usage and who use it  Administrative/End-user/Optimization  Technical/Business  Development/usage  In the data mart/At the workstation  Bank room/front room  Internal/External
  • 22. Functional Areas  Data Acquisition  Data stroage  Information delivery
  • 23. Data Acquisition  DWH process related to following functions. Data extraction Data transformation Data cleaning Data integration Data staging
  • 25. Data stroage  Data loading  Data archiving  Data management  Use metadata in this area for full data refresh and load.
  • 26.
  • 27. Information Delivery  Report generating  Query processing  Complex analysis Mostly this are meant for end-user. Metadata recorded in processes of other two areas. It also record OLAP-the developer and administrators are involved in this processes.
  • 28.
  • 29. Business METADATA  It connect business with DWH.  Business users need more than other users.  Business metadata is like a roadmap.  Tout guide-managers and analysis.
  • 30.  Must describe the contents in plain language giving information in business teerms.  Example The name of data tables (or) individual element must not be cryptic. The data item name-calc_pr_sle. You need to rename this as calculated-prior- month-sale
  • 31. Business metadata Contd.,  Much less structured than technical metadata.  Textual documents, spreadsheets, and even business rules and policies not written down completely.
  • 32. Examples of Business Metadata who Benefits?  Primarily benefits end-users. Managers Business analysis Power users Regular users Casual users Senior managers/ junior managers
  • 33. Technical Metadata  IT staff- Development and Administration of the data warehouse.  Who Benefits? Project manager Data warehouse administrator Metadata manager Database administrator Business analyst Data quality analyst