SlideShare a Scribd company logo
Building Data WareHouse
by Inmon
Chapter 09: Migration to the Architected Environment




                              http://it-slideshares.blogspot.com
9. Migration to the Architected
Environment
     1. A Migration Plan
     2.   The Feedback Loop
     3.   Strategic Considerations
     4.   Methodology and Migration
     5.   Summary




                             http://it-slideshares.blogspot.com
9.1 A Migration Plan
 Beginning point: Data Model -
  represents the information needs of
  the corporation.
 Data Model needs to identify at a
  minimum:
    ◦ Major subjects of the corporation
    ◦ Definition of the major subjects of the
      corporation
    ◦ Relationships between the major subjects
    ◦ Groupings of keys and attributes that
      more fully represent the major subjects
9.1 A Migration Plan (ct.)
 After having the corporate data
  model, the next activity is defining the
  system of record.
 It is nothing more than the identification
  of the “best” data that the corporation
  has:
    ◦   Most timely
    ◦   Most accurate
    ◦   Most complete
    ◦   Nearest to the external source
    ◦   Most structurally compatible
9.1 A Migration Plan (ct.)
9.1 A Migration Plan (ct.)
   Technological challenges in bringing
    the system-of-record data into the
    DW:
    ◦ A change in DBMS
    ◦ A change in operating systems
    ◦ The need to merge data from different
      DBMSs and operating systems
    ◦ The capture of the Web-based data in the
      Web logs
    ◦ A change in basic data formats
9.1 A Migration Plan (ct.)
 After the system of record is defined, the
  next step is to design the data
  warehouse.
 The following things need to be done:
    ◦ An element of time needs to be added to the
      key structure if one is not already present.
    ◦ All purely operational data needs to be
      eliminated.
    ◦ Referential integrity relationships need to be
      turned into artifacts.
    ◦ Derived data that is frequently needed is
      added to the design.
9.1 A Migration Plan (ct.)
9.1 A Migration Plan (ct.)
 After the data warehouse is
  designed, the next step is to design and
  build the interfaces between the system
  of record and the DW.
 Interfaces’ activities:
    ◦ Being an extract process
    ◦ Integration of data from the
      operational, application-oriented environment
    ◦ Alteration of the time basis of data
    ◦ Condensation of data
    ◦ Efficient scanning of the existing systems
      environment
9.1 A Migration Plan (ct.)
   Once the interface programs are
    designed and built, the next activity is
    to start the population of the first
    subject area:
    ◦ The first of the data is read in the legacy
      environment; and then it is captured and
      transported to the data warehouse
      environment.
    ◦ Directories are updated
    ◦ Metadata is created
    ◦ Indexes are made
                              http://it-slideshares.blogspot.com
9.1 A Migration Plan (ct.)


 Caution: If you
 wait for existing
 systems to be
 cleaned up, you
 will never build a
 data warehouse
9.2 The Feedback Loop
   At the heart of success in the long-term
    development of the data warehouse is the
    feedback loop between the data architect and
    the DSS analyst.
   The DSS analyst:
    ◦ uses the data warehouse as a basis for
      analysis
    ◦ conveys those requirements to the data
      architect
   The data architect:
    ◦ add data, delete data, alter data, and so forth
      based on the recommendations of the DSS
      analyst
                               http://it-slideshares.blogspot.com
9.2 The Feedback Loop
(ct.)




              http://it-slideshares.blogspot.com
9.3 Strategic
       Considerations
   The DW
    environment is
    designed and built
    for the purpose of
    supporting the DSS
    needs of the
    organization.




                         http://it-slideshares.blogspot.com
9.3 Strategic Considerations
     (ct.)
 Besides that, the
  corporation has
  operational needs
  as well.
 But the
  operational world
  is shown as being
  in a state of
  chaos.

                       http://it-slideshares.blogspot.com
9.3 Strategic Considerations
(ct.)
   The steps the data architect takes to
    restructure the operational
    environment:
    ◦   Create a ‘delta’ list
    ◦   The impact analysis
    ◦   Create the resource estimate
    ◦   All the preceding are packaged in a report
        that goes to information systems
        management.

                               http://it-slideshares.blogspot.com
9.3 Strategic Considerations
(ct.)
   Operation cleanup plan:
9.4 Methodology and Migration
 The methodology for the building of
  the data warehouse is called a spiral
  development methodology.
 The spiral methodology not only
  contains information about how to
  build a data warehouse, but also
  describes how to use the data
  warehouse.


                       http://it-slideshares.blogspot.com
9.4 Methodology and Migration
(ct.)
   The differences between the waterfall
    approach and the spiral approach:
9.5 Summary
 The starting point for the design of the data
  warehouse is the corporate data model,.
 The data warehouse is built iteratively.
 The development approach for the data
  warehouse environment is said to be an
  iterative or a spiral development approach.
 The feedback loop between the data
  architect and the end user is an important
  part of the migration process.


                           http://it-slideshares.blogspot.com

More Related Content

Similar to Lecture 09 - Migration to the Architected Environment

CV2015_06_30 -NG van Zyl
CV2015_06_30 -NG van ZylCV2015_06_30 -NG van Zyl
CV2015_06_30 -NG van Zyl
Gerhard van Zyl
 
IOUG93 - Technical Architecture for the Data Warehouse - Paper
IOUG93 - Technical Architecture for the Data Warehouse - PaperIOUG93 - Technical Architecture for the Data Warehouse - Paper
IOUG93 - Technical Architecture for the Data Warehouse - Paper
David Walker
 
Alejandro Chico Resume
Alejandro Chico ResumeAlejandro Chico Resume
Alejandro Chico Resume
Alex Chico
 

Similar to Lecture 09 - Migration to the Architected Environment (20)

Modern data warehouse presentation
Modern data warehouse presentationModern data warehouse presentation
Modern data warehouse presentation
 
How to make your data count webinar, 26 Nov 2018
How to make your data count webinar, 26 Nov 2018How to make your data count webinar, 26 Nov 2018
How to make your data count webinar, 26 Nov 2018
 
Database System Development Life Cycle ( DDLC )
Database System Development Life Cycle ( DDLC )Database System Development Life Cycle ( DDLC )
Database System Development Life Cycle ( DDLC )
 
Database Management Systems 2
Database Management Systems 2Database Management Systems 2
Database Management Systems 2
 
Cloud migration presentation
Cloud migration presentationCloud migration presentation
Cloud migration presentation
 
CV2015_06_30 -NG van Zyl
CV2015_06_30 -NG van ZylCV2015_06_30 -NG van Zyl
CV2015_06_30 -NG van Zyl
 
IOUG93 - Technical Architecture for the Data Warehouse - Paper
IOUG93 - Technical Architecture for the Data Warehouse - PaperIOUG93 - Technical Architecture for the Data Warehouse - Paper
IOUG93 - Technical Architecture for the Data Warehouse - Paper
 
Agile Data Warehouse Modeling: Introduction to Data Vault Data Modeling
Agile Data Warehouse Modeling: Introduction to Data Vault Data ModelingAgile Data Warehouse Modeling: Introduction to Data Vault Data Modeling
Agile Data Warehouse Modeling: Introduction to Data Vault Data Modeling
 
Database development life cycle unit 2 part 1
Database development life cycle  unit 2 part 1Database development life cycle  unit 2 part 1
Database development life cycle unit 2 part 1
 
INF3703 - Chapter 10 Database Development Process
INF3703 - Chapter 10 Database Development ProcessINF3703 - Chapter 10 Database Development Process
INF3703 - Chapter 10 Database Development Process
 
RESUME3
RESUME3RESUME3
RESUME3
 
Database design (conceptual, logical and physical design) unit 2 part 2
Database design (conceptual, logical and physical design)  unit 2 part 2Database design (conceptual, logical and physical design)  unit 2 part 2
Database design (conceptual, logical and physical design) unit 2 part 2
 
Data Engineer's Lunch #85: Designing a Modern Data Stack
Data Engineer's Lunch #85: Designing a Modern Data StackData Engineer's Lunch #85: Designing a Modern Data Stack
Data Engineer's Lunch #85: Designing a Modern Data Stack
 
Database development life cycle unit 2 part 1
Database development life cycle  unit 2 part 1Database development life cycle  unit 2 part 1
Database development life cycle unit 2 part 1
 
Who's in your Cloud? Cloud State Monitoring
Who's in your Cloud? Cloud State MonitoringWho's in your Cloud? Cloud State Monitoring
Who's in your Cloud? Cloud State Monitoring
 
(OTW13) Agile Data Warehousing: Introduction to Data Vault Modeling
(OTW13) Agile Data Warehousing: Introduction to Data Vault Modeling(OTW13) Agile Data Warehousing: Introduction to Data Vault Modeling
(OTW13) Agile Data Warehousing: Introduction to Data Vault Modeling
 
Using Data Platforms That Are Fit-For-Purpose
Using Data Platforms That Are Fit-For-PurposeUsing Data Platforms That Are Fit-For-Purpose
Using Data Platforms That Are Fit-For-Purpose
 
Agile Data Engineering - Intro to Data Vault Modeling (2016)
Agile Data Engineering - Intro to Data Vault Modeling (2016)Agile Data Engineering - Intro to Data Vault Modeling (2016)
Agile Data Engineering - Intro to Data Vault Modeling (2016)
 
Alejandro Chico Resume
Alejandro Chico ResumeAlejandro Chico Resume
Alejandro Chico Resume
 
Best Practices in the Cloud for Data Management (US)
Best Practices in the Cloud for Data Management (US)Best Practices in the Cloud for Data Management (US)
Best Practices in the Cloud for Data Management (US)
 

More from phanleson

Lecture 1 - Getting to know XML
Lecture 1 - Getting to know XMLLecture 1 - Getting to know XML
Lecture 1 - Getting to know XML
phanleson
 

More from phanleson (20)

Learning spark ch01 - Introduction to Data Analysis with Spark
Learning spark ch01 - Introduction to Data Analysis with SparkLearning spark ch01 - Introduction to Data Analysis with Spark
Learning spark ch01 - Introduction to Data Analysis with Spark
 
Firewall - Network Defense in Depth Firewalls
Firewall - Network Defense in Depth FirewallsFirewall - Network Defense in Depth Firewalls
Firewall - Network Defense in Depth Firewalls
 
Mobile Security - Wireless hacking
Mobile Security - Wireless hackingMobile Security - Wireless hacking
Mobile Security - Wireless hacking
 
Authentication in wireless - Security in Wireless Protocols
Authentication in wireless - Security in Wireless ProtocolsAuthentication in wireless - Security in Wireless Protocols
Authentication in wireless - Security in Wireless Protocols
 
E-Commerce Security - Application attacks - Server Attacks
E-Commerce Security - Application attacks - Server AttacksE-Commerce Security - Application attacks - Server Attacks
E-Commerce Security - Application attacks - Server Attacks
 
Hacking web applications
Hacking web applicationsHacking web applications
Hacking web applications
 
HBase In Action - Chapter 04: HBase table design
HBase In Action - Chapter 04: HBase table designHBase In Action - Chapter 04: HBase table design
HBase In Action - Chapter 04: HBase table design
 
HBase In Action - Chapter 10 - Operations
HBase In Action - Chapter 10 - OperationsHBase In Action - Chapter 10 - Operations
HBase In Action - Chapter 10 - Operations
 
Hbase in action - Chapter 09: Deploying HBase
Hbase in action - Chapter 09: Deploying HBaseHbase in action - Chapter 09: Deploying HBase
Hbase in action - Chapter 09: Deploying HBase
 
Learning spark ch11 - Machine Learning with MLlib
Learning spark ch11 - Machine Learning with MLlibLearning spark ch11 - Machine Learning with MLlib
Learning spark ch11 - Machine Learning with MLlib
 
Learning spark ch10 - Spark Streaming
Learning spark ch10 - Spark StreamingLearning spark ch10 - Spark Streaming
Learning spark ch10 - Spark Streaming
 
Learning spark ch09 - Spark SQL
Learning spark ch09 - Spark SQLLearning spark ch09 - Spark SQL
Learning spark ch09 - Spark SQL
 
Learning spark ch07 - Running on a Cluster
Learning spark ch07 - Running on a ClusterLearning spark ch07 - Running on a Cluster
Learning spark ch07 - Running on a Cluster
 
Learning spark ch06 - Advanced Spark Programming
Learning spark ch06 - Advanced Spark ProgrammingLearning spark ch06 - Advanced Spark Programming
Learning spark ch06 - Advanced Spark Programming
 
Learning spark ch05 - Loading and Saving Your Data
Learning spark ch05 - Loading and Saving Your DataLearning spark ch05 - Loading and Saving Your Data
Learning spark ch05 - Loading and Saving Your Data
 
Learning spark ch04 - Working with Key/Value Pairs
Learning spark ch04 - Working with Key/Value PairsLearning spark ch04 - Working with Key/Value Pairs
Learning spark ch04 - Working with Key/Value Pairs
 
Learning spark ch01 - Introduction to Data Analysis with Spark
Learning spark ch01 - Introduction to Data Analysis with SparkLearning spark ch01 - Introduction to Data Analysis with Spark
Learning spark ch01 - Introduction to Data Analysis with Spark
 
Hướng Dẫn Đăng Ký LibertaGia - A guide and introduciton about Libertagia
Hướng Dẫn Đăng Ký LibertaGia - A guide and introduciton about LibertagiaHướng Dẫn Đăng Ký LibertaGia - A guide and introduciton about Libertagia
Hướng Dẫn Đăng Ký LibertaGia - A guide and introduciton about Libertagia
 
Lecture 1 - Getting to know XML
Lecture 1 - Getting to know XMLLecture 1 - Getting to know XML
Lecture 1 - Getting to know XML
 
Lecture 4 - Adding XTHML for the Web
Lecture  4 - Adding XTHML for the WebLecture  4 - Adding XTHML for the Web
Lecture 4 - Adding XTHML for the Web
 

Recently uploaded

plant breeding methods in asexually or clonally propagated crops
plant breeding methods in asexually or clonally propagated cropsplant breeding methods in asexually or clonally propagated crops
plant breeding methods in asexually or clonally propagated crops
parmarsneha2
 
678020731-Sumas-y-Restas-Para-Colorear.pdf
678020731-Sumas-y-Restas-Para-Colorear.pdf678020731-Sumas-y-Restas-Para-Colorear.pdf
678020731-Sumas-y-Restas-Para-Colorear.pdf
CarlosHernanMontoyab2
 
Accounting and finance exit exam 2016 E.C.pdf
Accounting and finance exit exam 2016 E.C.pdfAccounting and finance exit exam 2016 E.C.pdf
Accounting and finance exit exam 2016 E.C.pdf
YibeltalNibretu
 

Recently uploaded (20)

Palestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptxPalestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptx
 
NLC-2024-Orientation-for-RO-SDO (1).pptx
NLC-2024-Orientation-for-RO-SDO (1).pptxNLC-2024-Orientation-for-RO-SDO (1).pptx
NLC-2024-Orientation-for-RO-SDO (1).pptx
 
Salient features of Environment protection Act 1986.pptx
Salient features of Environment protection Act 1986.pptxSalient features of Environment protection Act 1986.pptx
Salient features of Environment protection Act 1986.pptx
 
The Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve ThomasonThe Art Pastor's Guide to Sabbath | Steve Thomason
The Art Pastor's Guide to Sabbath | Steve Thomason
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
 
Instructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptxInstructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptx
 
Overview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with MechanismOverview on Edible Vaccine: Pros & Cons with Mechanism
Overview on Edible Vaccine: Pros & Cons with Mechanism
 
How to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS ModuleHow to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS Module
 
How to Break the cycle of negative Thoughts
How to Break the cycle of negative ThoughtsHow to Break the cycle of negative Thoughts
How to Break the cycle of negative Thoughts
 
Sectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdfSectors of the Indian Economy - Class 10 Study Notes pdf
Sectors of the Indian Economy - Class 10 Study Notes pdf
 
Jose-Rizal-and-Philippine-Nationalism-National-Symbol-2.pptx
Jose-Rizal-and-Philippine-Nationalism-National-Symbol-2.pptxJose-Rizal-and-Philippine-Nationalism-National-Symbol-2.pptx
Jose-Rizal-and-Philippine-Nationalism-National-Symbol-2.pptx
 
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup   New Member Orientation and Q&A (May 2024).pdfWelcome to TechSoup   New Member Orientation and Q&A (May 2024).pdf
Welcome to TechSoup New Member Orientation and Q&A (May 2024).pdf
 
How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...How libraries can support authors with open access requirements for UKRI fund...
How libraries can support authors with open access requirements for UKRI fund...
 
plant breeding methods in asexually or clonally propagated crops
plant breeding methods in asexually or clonally propagated cropsplant breeding methods in asexually or clonally propagated crops
plant breeding methods in asexually or clonally propagated crops
 
678020731-Sumas-y-Restas-Para-Colorear.pdf
678020731-Sumas-y-Restas-Para-Colorear.pdf678020731-Sumas-y-Restas-Para-Colorear.pdf
678020731-Sumas-y-Restas-Para-Colorear.pdf
 
Matatag-Curriculum and the 21st Century Skills Presentation.pptx
Matatag-Curriculum and the 21st Century Skills Presentation.pptxMatatag-Curriculum and the 21st Century Skills Presentation.pptx
Matatag-Curriculum and the 21st Century Skills Presentation.pptx
 
Basic Civil Engineering Notes of Chapter-6, Topic- Ecosystem, Biodiversity G...
Basic Civil Engineering Notes of Chapter-6,  Topic- Ecosystem, Biodiversity G...Basic Civil Engineering Notes of Chapter-6,  Topic- Ecosystem, Biodiversity G...
Basic Civil Engineering Notes of Chapter-6, Topic- Ecosystem, Biodiversity G...
 
Basic_QTL_Marker-assisted_Selection_Sourabh.ppt
Basic_QTL_Marker-assisted_Selection_Sourabh.pptBasic_QTL_Marker-assisted_Selection_Sourabh.ppt
Basic_QTL_Marker-assisted_Selection_Sourabh.ppt
 
Accounting and finance exit exam 2016 E.C.pdf
Accounting and finance exit exam 2016 E.C.pdfAccounting and finance exit exam 2016 E.C.pdf
Accounting and finance exit exam 2016 E.C.pdf
 
GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...
GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...
GIÁO ÁN DẠY THÊM (KẾ HOẠCH BÀI BUỔI 2) - TIẾNG ANH 8 GLOBAL SUCCESS (2 CỘT) N...
 

Lecture 09 - Migration to the Architected Environment

  • 1. Building Data WareHouse by Inmon Chapter 09: Migration to the Architected Environment http://it-slideshares.blogspot.com
  • 2. 9. Migration to the Architected Environment 1. A Migration Plan 2. The Feedback Loop 3. Strategic Considerations 4. Methodology and Migration 5. Summary http://it-slideshares.blogspot.com
  • 3. 9.1 A Migration Plan  Beginning point: Data Model - represents the information needs of the corporation.  Data Model needs to identify at a minimum: ◦ Major subjects of the corporation ◦ Definition of the major subjects of the corporation ◦ Relationships between the major subjects ◦ Groupings of keys and attributes that more fully represent the major subjects
  • 4. 9.1 A Migration Plan (ct.)  After having the corporate data model, the next activity is defining the system of record.  It is nothing more than the identification of the “best” data that the corporation has: ◦ Most timely ◦ Most accurate ◦ Most complete ◦ Nearest to the external source ◦ Most structurally compatible
  • 5. 9.1 A Migration Plan (ct.)
  • 6. 9.1 A Migration Plan (ct.)  Technological challenges in bringing the system-of-record data into the DW: ◦ A change in DBMS ◦ A change in operating systems ◦ The need to merge data from different DBMSs and operating systems ◦ The capture of the Web-based data in the Web logs ◦ A change in basic data formats
  • 7. 9.1 A Migration Plan (ct.)  After the system of record is defined, the next step is to design the data warehouse.  The following things need to be done: ◦ An element of time needs to be added to the key structure if one is not already present. ◦ All purely operational data needs to be eliminated. ◦ Referential integrity relationships need to be turned into artifacts. ◦ Derived data that is frequently needed is added to the design.
  • 8. 9.1 A Migration Plan (ct.)
  • 9. 9.1 A Migration Plan (ct.)  After the data warehouse is designed, the next step is to design and build the interfaces between the system of record and the DW.  Interfaces’ activities: ◦ Being an extract process ◦ Integration of data from the operational, application-oriented environment ◦ Alteration of the time basis of data ◦ Condensation of data ◦ Efficient scanning of the existing systems environment
  • 10. 9.1 A Migration Plan (ct.)  Once the interface programs are designed and built, the next activity is to start the population of the first subject area: ◦ The first of the data is read in the legacy environment; and then it is captured and transported to the data warehouse environment. ◦ Directories are updated ◦ Metadata is created ◦ Indexes are made http://it-slideshares.blogspot.com
  • 11. 9.1 A Migration Plan (ct.)  Caution: If you wait for existing systems to be cleaned up, you will never build a data warehouse
  • 12. 9.2 The Feedback Loop  At the heart of success in the long-term development of the data warehouse is the feedback loop between the data architect and the DSS analyst.  The DSS analyst: ◦ uses the data warehouse as a basis for analysis ◦ conveys those requirements to the data architect  The data architect: ◦ add data, delete data, alter data, and so forth based on the recommendations of the DSS analyst http://it-slideshares.blogspot.com
  • 13. 9.2 The Feedback Loop (ct.) http://it-slideshares.blogspot.com
  • 14. 9.3 Strategic Considerations  The DW environment is designed and built for the purpose of supporting the DSS needs of the organization. http://it-slideshares.blogspot.com
  • 15. 9.3 Strategic Considerations (ct.)  Besides that, the corporation has operational needs as well.  But the operational world is shown as being in a state of chaos. http://it-slideshares.blogspot.com
  • 16. 9.3 Strategic Considerations (ct.)  The steps the data architect takes to restructure the operational environment: ◦ Create a ‘delta’ list ◦ The impact analysis ◦ Create the resource estimate ◦ All the preceding are packaged in a report that goes to information systems management. http://it-slideshares.blogspot.com
  • 17. 9.3 Strategic Considerations (ct.)  Operation cleanup plan:
  • 18. 9.4 Methodology and Migration  The methodology for the building of the data warehouse is called a spiral development methodology.  The spiral methodology not only contains information about how to build a data warehouse, but also describes how to use the data warehouse. http://it-slideshares.blogspot.com
  • 19. 9.4 Methodology and Migration (ct.)  The differences between the waterfall approach and the spiral approach:
  • 20. 9.5 Summary  The starting point for the design of the data warehouse is the corporate data model,.  The data warehouse is built iteratively.  The development approach for the data warehouse environment is said to be an iterative or a spiral development approach.  The feedback loop between the data architect and the end user is an important part of the migration process. http://it-slideshares.blogspot.com