Unit 4 scd2-exercise 1-solution

•Download as PPTX, PDF•

0 likes•230 views

Girija Muscut

This presentation gives solution for the exercise 1 in Unit 4 slowly changing dimension type 2 (SCD 2)

Software

Unit 4 SLOWLY CHANGIN DIMENSION 2 –
Exercise -1 Solution (SCD2)
https://www.oercommons.org/authoring/28550-etl-using-pentaho-spoon
https://www.oercommons.org/authoring/28693-etl-using-pentaho-spoon-lecture-notes-ppt-exercise
Dr. Girija Narasimhan 1

Exercise:
Create table employ2(eid number(5),ename varchar2(15),salary number(5));
insert into employ2 values(1001,'Alaa',1800);
insert into employ2 values(1002,'Ravi',1500);
select * from employ2;
create table emp_dim_scd2(emp_sur_key number(5),date_from date,date_to date,version number(6),dim_eid
number(5),ename varchar2(15),salary number(5));
update employ2 set salary=2500 where eid=1001;
select * from emp_dim_scd2;
insert into employ2 values(1003,'Suha',1900);
Dr. Girija Narasimhan 2

Dr. Girija Narasimhan 3
Create employ2 table and emp_dim_scd2 table

Dr. Girija Narasimhan 4
Drag and include “Table Input”

Connect the table employ2 table and preview the data
Dr. Girija Narasimhan 5

Drag and include dimension lookup/update
connect table input with dimension lookup/update
Dr. Girija Narasimhan 6

Connect the database
Dr. Girija Narasimhan 7

Dr. Girija Narasimhan 8
Key field
surrogate key
Date from
Date to

Update the eid=1001 salary as 2500 in employ2 table
Dr. Girija Narasimhan 10

Execute the transformation
Dr. Girija Narasimhan 11

Preview data and updated record information
Dr. Girija Narasimhan 12

Check the emp_dim_scd1 table records updated history
Dr. Girija Narasimhan 13

Insert new record
Dr. Girija Narasimhan 14

Execute the transformation
Dr. Girija Narasimhan 15

Dr. Girija Narasimhan 16
Preview the data and
newly inserted record
information

Recently uploaded

BoxLang: Review our Visionary Licenses of 2024

Ortus Solutions, Corp

RISE with SAP and Journey to the Intelligent Enterprise

Srikant77

Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...

Anthony Dahanne

Les Buildpacks existent depuis plus de 10 ans ! D’abord, ils étaient utilisés pour détecter et construire une application avant de la déployer sur certains PaaS. Ensuite, nous avons pu créer des images Docker (OCI) avec leur dernière génération, les Cloud Native Buildpacks (CNCF en incubation). Sont-ils une bonne alternative au Dockerfile ? Que sont les buildpacks Paketo ? Quelles communautés les soutiennent et comment ? Venez le découvrir lors de cette session ignite

Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL

Natan Silnitsky

In software engineering, the right architecture is essential for robust, scalable platforms. Wix has undergone a pivotal shift from event sourcing to a CRUD-based model for its microservices. This talk will chart the course of this pivotal journey. Event sourcing, which records state changes as immutable events, provided robust auditing and "time travel" debugging for Wix Stores' microservices. Despite its benefits, the complexity it introduced in state management slowed development. Wix responded by adopting a simpler, unified CRUD model. This talk will explore the challenges of event sourcing and the advantages of Wix's new "CRUD on steroids" approach, which streamlines API integration and domain event management while preserving data integrity and system resilience. Participants will gain valuable insights into Wix's strategies for ensuring atomicity in database updates and event production, as well as caching, materialization, and performance optimization techniques within a distributed system. Join us to discover how Wix has mastered the art of balancing simplicity and extensibility, and learn how the re-adoption of the modest CRUD has turbocharged their development velocity, resilience, and scalability in a high-growth environment.

Understanding Globus Data Transfers with NetSage

Globus

NetSage is an open privacy-aware network measurement, analysis, and visualization service designed to help end-users visualize and reason about large data transfers. NetSage traditionally has used a combination of passive measurements, including SNMP and flow data, as well as active measurements, mainly perfSONAR, to provide longitudinal network performance data visualization. It has been deployed by dozens of networks world wide, and is supported domestically by the Engagement and Performance Operations Center (EPOC), NSF #2328479. We have recently expanded the NetSage data sources to include logs for Globus data transfers, following the same privacy-preserving approach as for Flow data. Using the logs for the Texas Advanced Computing Center (TACC) as an example, this talk will walk through several different example use cases that NetSage can answer, including: Who is using Globus to share data with my institution, and what kind of performance are they able to achieve? How many transfers has Globus supported for us? Which sites are we sharing the most data with, and how is that changing over time? How is my site using Globus to move data internally, and what kind of performance do we see for those transfers? What percentage of data transfers at my institution used Globus, and how did the overall data transfer performance compare to the Globus users?

Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...

Globus

The U.S. Geological Survey (USGS) has made substantial investments in meeting evolving scientific, technical, and policy driven demands on storing, managing, and delivering data. As these demands continue to grow in complexity and scale, the USGS must continue to explore innovative solutions to improve its management, curation, sharing, delivering, and preservation approaches for large-scale research data. Supporting these needs, the USGS has partnered with the University of Chicago-Globus to research and develop advanced repository components and workflows leveraging its current investment in Globus. The primary outcome of this partnership includes the development of a prototype enterprise repository, driven by USGS Data Release requirements, through exploration and implementation of the entire suite of the Globus platform offerings, including Globus Flow, Globus Auth, Globus Transfer, and Globus Search. This presentation will provide insights into this research partnership, introduce the unique requirements and challenges being addressed and provide relevant project progress.

TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR

Tier1 app

Even though at surface level ‘java.lang.OutOfMemoryError’ appears as one single error; underlyingly there are 9 types of OutOfMemoryError. Each type of OutOfMemoryError has different causes, diagnosis approaches and solutions. This session equips you with the knowledge, tools, and techniques needed to troubleshoot and conquer OutOfMemoryError in all its forms, ensuring smoother, more efficient Java applications.

Using IESVE for Room Loads Analysis - Australia & New Zealand

IES VE

Lecture 1 Introduction to games development

abdulrafaychaudhry

Orion Context Broker introduction 20240604

Fermin Galan

A Sighting of filterA in Typelevel Rite of Passage

Philip Schwarz

Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better

XfilesPro

Enterprise Resource Planning System in Telangana

NYGGS Automation Suite

Enterprise Resource Planning System includes various modules that reduce any business's workload. Additionally, it organizes the workflows, which drives towards enhancing productivity. Here are a detailed explanation of the ERP modules. Going through the points will help you understand how the software is changing the work dynamics. To know more details here: https://blogs.nyggs.com/nyggs/enterprise-resource-planning-erp-system-modules/

Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...

Mind IT Systems

First Steps with Globus Compute Multi-User Endpoints

Globus

In this presentation we will share our experiences around getting started with the Globus Compute multi-user endpoint. Working with the Pharmacology group at the University of Auckland, we have previously written an application using Globus Compute that can offload computationally expensive steps in the researcher's workflows, which they wish to manage from their familiar Windows environments, onto the NeSI (New Zealand eScience Infrastructure) cluster. Some of the challenges we have encountered were that each researcher had to set up and manage their own single-user globus compute endpoint and that the workloads had varying resource requirements (CPUs, memory and wall time) between different runs. We hope that the multi-user endpoint will help to address these challenges and share an update on our progress here.

Quarkus Hidden and Forbidden Extensions

Max Andersen

Globus Compute Introduction - GlobusWorld 2024

Globus

How to Position Your Globus Data Portal for Success Ten Good Practices

Globus

Science gateways allow science and engineering communities to access shared data, software, computing services, and instruments. Science gateways have gained a lot of traction in the last twenty years, as evidenced by projects such as the Science Gateways Community Institute (SGCI) and the Center of Excellence on Science Gateways (SGX3) in the US, The Australian Research Data Commons (ARDC) and its platforms in Australia, and the projects around Virtual Research Environments in Europe. A few mature frameworks have evolved with their different strengths and foci and have been taken up by a larger community such as the Globus Data Portal, Hubzero, Tapis, and Galaxy. However, even when gateways are built on successful frameworks, they continue to face the challenges of ongoing maintenance costs and how to meet the ever-expanding needs of the community they serve with enhanced features. It is not uncommon that gateways with compelling use cases are nonetheless unable to get past the prototype phase and become a full production service, or if they do, they don't survive more than a couple of years. While there is no guaranteed pathway to success, it seems likely that for any gateway there is a need for a strong community and/or solid funding streams to create and sustain its success. With over twenty years of examples to draw from, this presentation goes into detail for ten factors common to successful and enduring gateways that effectively serve as best practices for any new or developing gateway.

How Recreation Management Software Can Streamline Your Operations.pptx

wottaspaceseo

Recreation management software streamlines operations by automating key tasks such as scheduling, registration, and payment processing, reducing manual workload and errors. It provides centralized management of facilities, classes, and events, ensuring efficient resource allocation and facility usage. The software offers user-friendly online portals for easy access to bookings and program information, enhancing customer experience. Real-time reporting and data analytics deliver insights into attendance and preferences, aiding in strategic decision-making. Additionally, effective communication tools keep participants and staff informed with timely updates. Overall, recreation management software enhances efficiency, improves service delivery, and boosts customer satisfaction.

Navigating the Metaverse: A Journey into Virtual Evolution"

Donna Lenk

Recently uploaded (20)

BoxLang: Review our Visionary Licenses of 2024

RISE with SAP and Journey to the Intelligent Enterprise

Paketo Buildpacks : la meilleure façon de construire des images OCI? DevopsDa...

Beyond Event Sourcing - Embracing CRUD for Wix Platform - Java.IL

Understanding Globus Data Transfers with NetSage

Exploring Innovations in Data Repository Solutions - Insights from the U.S. G...

TROUBLESHOOTING 9 TYPES OF OUTOFMEMORYERROR

Using IESVE for Room Loads Analysis - Australia & New Zealand

Lecture 1 Introduction to games development

Orion Context Broker introduction 20240604

A Sighting of filterA in Typelevel Rite of Passage

Webinar: Salesforce Document Management 2.0 - Smarter, Faster, Better

Enterprise Resource Planning System in Telangana

Custom Healthcare Software for Managing Chronic Conditions and Remote Patient...

First Steps with Globus Compute Multi-User Endpoints

Quarkus Hidden and Forbidden Extensions

Globus Compute Introduction - GlobusWorld 2024

How to Position Your Globus Data Portal for Success Ten Good Practices

How Recreation Management Software Can Streamline Your Operations.pptx

Navigating the Metaverse: A Journey into Virtual Evolution"

Unit 4 scd2-exercise 1-solution

1. Unit 4 SLOWLY CHANGIN DIMENSION 2 – Exercise -1 Solution (SCD2) https://www.oercommons.org/authoring/28550-etl-using-pentaho-spoon https://www.oercommons.org/authoring/28693-etl-using-pentaho-spoon-lecture-notes-ppt-exercise Dr. Girija Narasimhan 1

2. Exercise: Create table employ2(eid number(5),ename varchar2(15),salary number(5)); insert into employ2 values(1001,'Alaa',1800); insert into employ2 values(1002,'Ravi',1500); select * from employ2; create table emp_dim_scd2(emp_sur_key number(5),date_from date,date_to date,version number(6),dim_eid number(5),ename varchar2(15),salary number(5)); update employ2 set salary=2500 where eid=1001; select * from emp_dim_scd2; insert into employ2 values(1003,'Suha',1900); Dr. Girija Narasimhan 2

3. Dr. Girija Narasimhan 3 Create employ2 table and emp_dim_scd2 table

4. Dr. Girija Narasimhan 4 Drag and include “Table Input”

5. Connect the table employ2 table and preview the data Dr. Girija Narasimhan 5

6. Drag and include dimension lookup/update connect table input with dimension lookup/update Dr. Girija Narasimhan 6

7. Connect the database Dr. Girija Narasimhan 7

8. Dr. Girija Narasimhan 8 Key field surrogate key Date from Date to

9. Select Fields Dr. Girija Narasimhan 9

10. Update the eid=1001 salary as 2500 in employ2 table Dr. Girija Narasimhan 10

11. Execute the transformation Dr. Girija Narasimhan 11

12. Preview data and updated record information Dr. Girija Narasimhan 12

13. Check the emp_dim_scd1 table records updated history Dr. Girija Narasimhan 13

14. Insert new record Dr. Girija Narasimhan 14