Education for all..

1. DWH-Ahsan AbdullahDWH-Ahsan Abdullah
11
Data WarehousingData Warehousing
Lab Lect-2Lab Lect-2
Lab Data SetLab Data Set
Virtual University of PakistanVirtual University of Pakistan
Ahsan Abdullah
Assoc. Prof. & Head
Center for Agro-Informatics Research
www.nu.edu.pk/cairindex.asp
FAST National University of Computers & Emerging Sciences, IslamabadFAST National University of Computers & Emerging Sciences, Islamabad

2. DWH-Ahsan Abdullah
2
Multi-Campus UniversityMulti-Campus University

3. DWH-Ahsan Abdullah
3
Degree ProgramsDegree Programs

4. DWH-Ahsan Abdullah
4
Disciplines for BSDisciplines for BS

5. DWH-Ahsan Abdullah
5
Disciplines for MSDisciplines for MS

6. DWH-Ahsan Abdullah
6
The needThe need
 Head Office wants a central dataHead Office wants a central data
repository for decision support i.e. a DWHrepository for decision support i.e. a DWH

7. DWH-Ahsan Abdullah
7
Students Record Keeping & Mgmt.Students Record Keeping & Mgmt.

8. DWH-Ahsan Abdullah
8
Data from Lahore CampusData from Lahore Campus

9. DWH-Ahsan Abdullah
9
Data from Lahore Campus: SampleData from Lahore Campus: Sample

10. DWH-Ahsan Abdullah
10
Lahore: Header of Student TableLahore: Header of Student Table
 SIDSID
 St_NameSt_Name
 Father_NameFather_Name

11. DWH-Ahsan Abdullah
11
Lahore: Header of Student TableLahore: Header of Student Table
 GenderGender
 AddressAddress
 [Date of Birth][Date of Birth]
 [Reg Date][Reg Date]

12. DWH-Ahsan Abdullah
12
Lahore: Header of Student TableLahore: Header of Student Table
 [Reg Status][Reg Status]
 [Degree Status][Degree Status]
 [Last Degree][Last Degree]

13. DWH-Ahsan Abdullah
13
Lahore: Header of Course Reg. TableLahore: Header of Course Reg. Table
 SIDSID
 DegreeDegree
 SemesterSemester
 CourseCourse
 MarksMarks
 DisciplineDiscipline

14. DWH-Ahsan Abdullah
14
Lahore: Facts About DataLahore: Facts About Data

15. DWH-Ahsan Abdullah
15
Data from Karachi CampusData from Karachi Campus

16. DWH-Ahsan Abdullah
16
Data from Karachi Campus: SampleData from Karachi Campus: Sample

17. DWH-Ahsan Abdullah
17
Karachi: Header of Student TableKarachi: Header of Student Table
 St_IDSt_ID
 NameName
 FatherFather
 DoBDoB
 M/FM/F
 DoRegDoReg
 RStatusRStatus
 DStatusDStatus
 AddressAddress
 QualificationQualification

18. DWH-Ahsan Abdullah
18
Karachi: Header of Course Reg. TableKarachi: Header of Course Reg. Table
 SID:SID:
 CoursesCourses
 ScoreScore
 SemSem
 DispDisp
Degree (BS/MS) is missing because separateDegree (BS/MS) is missing because separate
books are maintained, but the issue isbooks are maintained, but the issue is
critical while loading datacritical while loading data

19. DWH-Ahsan Abdullah
19
Karachi: Facts About DataKarachi: Facts About Data

20. DWH-Ahsan Abdullah
20
Data from Islamabad CampusData from Islamabad Campus

21. DWH-Ahsan Abdullah
21
Data from Islamabad Campus: SampleData from Islamabad Campus: Sample

22. DWH-Ahsan Abdullah
22
Islamabad: Header of Student TableIslamabad: Header of Student Table
 Roll NumRoll Num
 NameName
 FatherFather
 Reg DateReg Date
 Reg StatusReg Status
 Degree StatusDegree Status
 Date of BirthDate of Birth
 EducationEducation
 GenderGender
 AddressAddress

23. DWH-Ahsan Abdullah
23
Islamabad: Header of Course Reg. TableIslamabad: Header of Course Reg. Table
 Roll Num:Roll Num:
 CourseCourse
 MarksMarks
 DisciplineDiscipline
 SessionSession
Degree (BS/MS) is missing, whereasDegree (BS/MS) is missing, whereas
same table contains records for both.same table contains records for both.
Only way to differentiate is throughOnly way to differentiate is through
discipline attribute.discipline attribute.

24. DWH-Ahsan Abdullah
24
Islamabad: Facts About DataIslamabad: Facts About Data

25. DWH-Ahsan Abdullah
25
ExerciseExercise

26. DWH-Ahsan Abdullah
26
Problems with Adhoc ApproachProblems with Adhoc Approach

27. DWH-Ahsan Abdullah
27
LAHORE
KARACHI
ISLAMABAD
PESHAWAR
Text Files
Excel Book
MS-ACCESS
Text Files
Uses
Uses
Uses
Uses
Problem-1: Non-Standard data sourcesProblem-1: Non-Standard data sources

28. DWH-Ahsan Abdullah
28
Problem-2: Non-standard attributesProblem-2: Non-standard attributes

29. DWH-Ahsan Abdullah
29
Problem-3: Non Normalized databaseProblem-3: Non Normalized database

30. DWH-Ahsan Abdullah
30
Notepad: IssuesNotepad: Issues

31. DWH-Ahsan Abdullah
31
MS-Excel: IssuesMS-Excel: Issues

32. DWH-Ahsan Abdullah
32
MS-Access: IssuesMS-Access: Issues

33. DWH-Ahsan Abdullah
33
Problem StatementProblem Statement

34. DWH-Ahsan Abdullah
34
Data from Peshawar CampusData from Peshawar Campus
 Data at Peshawar campus is stored inData at Peshawar campus is stored in
Text filesText files
 To store data regarding one completeTo store data regarding one complete
batch 2 text files are usedbatch 2 text files are used
 Lhr_Student_batch (Student record)Lhr_Student_batch (Student record)
 Lhr_Detail_batch (Course Reg. record)Lhr_Detail_batch (Course Reg. record)
 22 text files for 11 BS batches22 text files for 11 BS batches
 8 text files for 4 MS batches8 text files for 4 MS batches

35. DWH-Ahsan Abdullah
35
Data from Peshawar Campus: SampleData from Peshawar Campus: Sample

36. DWH-Ahsan Abdullah
36
Peshawar: Header of Student TablePeshawar: Header of Student Table
 Reg#:Reg#: Student identityStudent identity
 Name:Name: Student nameStudent name
 Father:Father: Father nameFather name
 Address:Address: Permanent addressPermanent address
 Date of Birth:Date of Birth: Date of BirthDate of Birth
 lastDeg:lastDeg: Last degree achievedLast degree achieved
 Reg Date:Reg Date: Date of EnrollmentDate of Enrollment
 Reg Status:Reg Status: Status of Enrollment (A/T)Status of Enrollment (A/T)
 Degree Status:Degree Status: Status of Degree (C/I)Status of Degree (C/I)

37. DWH-Ahsan Abdullah
37
Peshawar: Header of Course Reg. TablePeshawar: Header of Course Reg. Table
 Reg#:Reg#:
 Courses:Courses: Course codeCourse code
 Score:Score: Out of 100Out of 100
 Program:Program: CS/TC/SE/CECS/TC/SE/CE
 Sem:Sem: Fall/SpringFall/Spring
 Year:Year: YYYY e.g. 1999YYYY e.g. 1999
We need to identify semester sessionWe need to identify semester session
(fall04) through combination of Sem and(fall04) through combination of Sem and
YearYear