ETL

1. CO1
EXPERIMENT 2:Designofa Data Warehouse, Understandthe importance
of pre-processing by performing the ETL Operations
Date of the Session: ___/___/___ Time of the Session: _____to______
Pre-Lab:
1. Install Python of version 3.6.9 and Anaconda version 3. Launch Jupyter Notebook IDE and
load required python libraries
A.
Q2. Analyze data analytics in the context of data warehousing?
A.
3. Identify the importance of data modelling?
A.

2. 4. Explore the need of Real-Time ETL in Data warehouse?
A.
5. Find out the role of impact analysis in the ETL system?
A.
6. Mention the significance of the ETL system in the Data warehouse?
A.

3. In-Lab:
Task #1:Understand the importance of pre-processing by performing the
ETL Operations implemented using MySql connector and python
programming.
1. Perform the following ETL operations by making the use of python built-in packages and
SQL commands.
a. Extracting
b. Transforming and
c. Loading tables of data.
Dataset: Use the following link to download the dataset
https://drive.google.com/file/d/1M7phlSaw5mal3RlEUCTeOlQCEpQ5iHY3/view?usp=shari
ng
i. From the given dataset perform Extract operation using python etl library to convert
the data stored in json file to zip file.
ii. From the extracted data perform Transform operation to convert the data into a single
standard dictionary format.
iii. Use MySQL cursor to load the data from CSV file to MySQL by creating the schema
and tables
Writing space of the problem (For Student’s use only)

4. (Writing space for In-Lab)

5. (Writing space for In-Lab)

6. Post-Lab:
1. Summarize all your findings from the In-Lab experiments and explain your conclusions.
Writing space of the problem (For Student’s use only)
2. Give a brief description about the libraries used and required from performing the ETL
operations.
Writing space of the problem (For Student’s use only)
(Writing space for Post-Lab)

7. Viva Voice:
1.What are the characteristics of Data Warehouse?
2.What is Operation Data Source?
3.What is the difference between Manual Testing and ETL Testing?
4.What are the steps followed in ETL testing process?
5.What is the difference between ETL tools and OLAP tools?