SlideShare a Scribd company logo
1 of 21
Hong-Bing Li
Hongbingli88@gmail.com
Slide Contents
 3 SQL Server Integration Services (SSIS)
 8 SQL Programming
 15 SQL Server Reporting Services (SSRS)
 18 SharePoint Server
This portfolio contains examples of my business intelligence
projects using Microsoft BI Product Stack.
SQL Server Integration
Services (SSIS)
3
A new database “All Works” is setup as the staging area for the ETL process. A
thorough understanding of the relationships between the tables in the following
data diagram is important in determining the sequence of tables to be loaded and
in enforcing referential integrity.
4
A Script Task is utilized to maintain multiple sets of variables with scripts in C#, for
instance, one for keeping track of row counts of data processed dynamically at the
folder level, one for row counts at the file level.
One SSIS package is created to do ETL for one target table. The following illustrates
the data processing within the Job Timesheets package: the data process pipeline
starts by extracting data from a CSV file. The data is then conversed, processed and
transformed (filter, remove duplicates, lookups, validate) as it passes through the
pipeline, and is finally loaded into the target job timesheets table either as inserts
or updates. It logs any rows that error out for review and correction. Similarly,
seven more packages are generated for seven target tables.
6
7
A Sequence Container is deployed to run the eight ETL packages in sequence based on the
relationships between the tables in the “All Works” Database to ensure referential integrity. If the
eight packages are processed successfully, data maintenance tasks are performed. A success or
failure notice email will be sent out depending on whether the data maintenance tasks are all
successfully completed or not.
A Master Package is created to contain the Sequence Container, the maintenance tasks and the
email notices; then a SQL Server Agent Job is setup to run the Master Package on a predefined
schedule to automate the entire data processing procedure.
SQL Programming
SQL Programming covers a broad range of content: Data Types and
Variables, Specialized Functions, Stored Procedures, Control-Of-Flow Operations,
Error Handling, Etc. Due to time/space constraints, I will illustrate only some of
the relatively new SQL functions/procedures/ programs that I have used in my
projects in the following:
1. Data Modification: OUTPUT clause, MERGE, select TOP(with ties) option
2. Aggregation: RANK() OVER (Partition by), GROUPING SETS
3. SQL Functions: PIVOT, CROSS APPLY
4. Common Table Expression (CTE), Correlated and Recursive Queries
5. User Defined Functions (UDF) that returns TABLE type
6. Error Handling Program:
Begin Try...End Try
Begin Catch...End Catch
SQL Server Reporting
Services (SSRS)
15
16
17
Continued: Primary Dashboard
SharePoint Server
18
Employee Labor Report
Deployed to a SharePoint Server
configure security settings: give users/
groups appropriate permissions.
---The End---
Hong-Bing Li, February, 2015
Thank you for viewing this presentation!

More Related Content

What's hot

Business Intelligence Portfolio
Business Intelligence PortfolioBusiness Intelligence Portfolio
Business Intelligence Portfolio
guestc38d4b
 
05 SSIS Control Flow
05 SSIS Control Flow05 SSIS Control Flow
05 SSIS Control Flow
Slava Kokaev
 
Aggregation
AggregationAggregation
Aggregation
Md Khan
 
Database migration
Database migrationDatabase migration
Database migration
Opris Monica
 
Combining and easing the access of the eswc semantic web data 0
Combining and easing the access of the eswc semantic web data 0Combining and easing the access of the eswc semantic web data 0
Combining and easing the access of the eswc semantic web data 0
STIinnsbruck
 

What's hot (18)

Business Intelligence Portfolio
Business Intelligence PortfolioBusiness Intelligence Portfolio
Business Intelligence Portfolio
 
Data mining with ms access
Data mining with ms accessData mining with ms access
Data mining with ms access
 
Architecture of integration services
Architecture of integration servicesArchitecture of integration services
Architecture of integration services
 
Working with designers
Working with designersWorking with designers
Working with designers
 
The Ultimate Guide to Oracle web logic server 12c administration i 1z0 133
 The Ultimate Guide to Oracle web logic server 12c  administration i  1z0 133 The Ultimate Guide to Oracle web logic server 12c  administration i  1z0 133
The Ultimate Guide to Oracle web logic server 12c administration i 1z0 133
 
Bilir's Business Intelligence Portfolio SSIS Project
Bilir's Business Intelligence Portfolio SSIS ProjectBilir's Business Intelligence Portfolio SSIS Project
Bilir's Business Intelligence Portfolio SSIS Project
 
06 SSIS Data Flow
06 SSIS Data Flow06 SSIS Data Flow
06 SSIS Data Flow
 
The Ultimate Guide to Oracle solaris 11 advanced system administration 1 z0 822
The Ultimate Guide to Oracle solaris 11 advanced system administration  1 z0 822The Ultimate Guide to Oracle solaris 11 advanced system administration  1 z0 822
The Ultimate Guide to Oracle solaris 11 advanced system administration 1 z0 822
 
The Ultimate Guide to Oracle solaris 11 installation and configuration essent...
The Ultimate Guide to Oracle solaris 11 installation and configuration essent...The Ultimate Guide to Oracle solaris 11 installation and configuration essent...
The Ultimate Guide to Oracle solaris 11 installation and configuration essent...
 
05 SSIS Control Flow
05 SSIS Control Flow05 SSIS Control Flow
05 SSIS Control Flow
 
CDC
CDCCDC
CDC
 
Metabarcoding QIIME2 workshop - Classification answers
Metabarcoding QIIME2 workshop - Classification answersMetabarcoding QIIME2 workshop - Classification answers
Metabarcoding QIIME2 workshop - Classification answers
 
Introduction to database with ms access.hetvii
Introduction to database with ms access.hetviiIntroduction to database with ms access.hetvii
Introduction to database with ms access.hetvii
 
Aggregation
AggregationAggregation
Aggregation
 
Database migration
Database migrationDatabase migration
Database migration
 
SQL Server Integration Services – Enterprise Manageability
SQL Server Integration Services – Enterprise ManageabilitySQL Server Integration Services – Enterprise Manageability
SQL Server Integration Services – Enterprise Manageability
 
Test Strategy Utilising Mc Useful Tools
Test Strategy Utilising Mc Useful ToolsTest Strategy Utilising Mc Useful Tools
Test Strategy Utilising Mc Useful Tools
 
Combining and easing the access of the eswc semantic web data 0
Combining and easing the access of the eswc semantic web data 0Combining and easing the access of the eswc semantic web data 0
Combining and easing the access of the eswc semantic web data 0
 

Viewers also liked

SSRS Sub-Report Demo Hong-Bing Li
SSRS Sub-Report Demo Hong-Bing LiSSRS Sub-Report Demo Hong-Bing Li
SSRS Sub-Report Demo Hong-Bing Li
Hong-Bing Li
 
SSRS Report Demo By Hong-Bing Li
SSRS Report Demo By Hong-Bing LiSSRS Report Demo By Hong-Bing Li
SSRS Report Demo By Hong-Bing Li
Hong-Bing Li
 
SSRS Sub-Report Demo Hong-Bing Li
SSRS Sub-Report Demo Hong-Bing LiSSRS Sub-Report Demo Hong-Bing Li
SSRS Sub-Report Demo Hong-Bing Li
Hong-Bing Li
 
SSRS Sub-Report Demo Hong-Bing Li
SSRS Sub-Report Demo Hong-Bing LiSSRS Sub-Report Demo Hong-Bing Li
SSRS Sub-Report Demo Hong-Bing Li
Hong-Bing Li
 
SSRS Sub Report Demo Hong-Bing Li
SSRS Sub Report Demo Hong-Bing LiSSRS Sub Report Demo Hong-Bing Li
SSRS Sub Report Demo Hong-Bing Li
Hong-Bing Li
 
SSIS_SSAS_SSRS_SP_PPS_HongBingLi
SSIS_SSAS_SSRS_SP_PPS_HongBingLiSSIS_SSAS_SSRS_SP_PPS_HongBingLi
SSIS_SSAS_SSRS_SP_PPS_HongBingLi
Hong-Bing Li
 
SSIS_SSRS_PPS_SP_SSAS_Hong_Bing Li
SSIS_SSRS_PPS_SP_SSAS_Hong_Bing LiSSIS_SSRS_PPS_SP_SSAS_Hong_Bing Li
SSIS_SSRS_PPS_SP_SSAS_Hong_Bing Li
Hong-Bing Li
 
Ssis Ssas Ssrs Sp Pps Hong Bing Li
Ssis Ssas Ssrs Sp Pps Hong Bing LiSsis Ssas Ssrs Sp Pps Hong Bing Li
Ssis Ssas Ssrs Sp Pps Hong Bing Li
Hong-Bing Li
 
C:\fakepath\ssis ssas sssrs_pps_hong_bingli_v2003
C:\fakepath\ssis ssas sssrs_pps_hong_bingli_v2003C:\fakepath\ssis ssas sssrs_pps_hong_bingli_v2003
C:\fakepath\ssis ssas sssrs_pps_hong_bingli_v2003
Hong-Bing Li
 

Viewers also liked (14)

SSRS Demo
SSRS DemoSSRS Demo
SSRS Demo
 
SSRS Sub-Report Demo Hong-Bing Li
SSRS Sub-Report Demo Hong-Bing LiSSRS Sub-Report Demo Hong-Bing Li
SSRS Sub-Report Demo Hong-Bing Li
 
Ssrs demo
Ssrs demoSsrs demo
Ssrs demo
 
SSRS Report Demo By Hong-Bing Li
SSRS Report Demo By Hong-Bing LiSSRS Report Demo By Hong-Bing Li
SSRS Report Demo By Hong-Bing Li
 
SSRS Sub-Report Demo Hong-Bing Li
SSRS Sub-Report Demo Hong-Bing LiSSRS Sub-Report Demo Hong-Bing Li
SSRS Sub-Report Demo Hong-Bing Li
 
SSRS Sub-Report Demo Hong-Bing Li
SSRS Sub-Report Demo Hong-Bing LiSSRS Sub-Report Demo Hong-Bing Li
SSRS Sub-Report Demo Hong-Bing Li
 
SSRS Sub Report Demo Hong-Bing Li
SSRS Sub Report Demo Hong-Bing LiSSRS Sub Report Demo Hong-Bing Li
SSRS Sub Report Demo Hong-Bing Li
 
SSIS_SSAS_SSRS_SP_PPS_HongBingLi
SSIS_SSAS_SSRS_SP_PPS_HongBingLiSSIS_SSAS_SSRS_SP_PPS_HongBingLi
SSIS_SSAS_SSRS_SP_PPS_HongBingLi
 
SSIS_SSRS_PPS_SP_SSAS_Hong_Bing Li
SSIS_SSRS_PPS_SP_SSAS_Hong_Bing LiSSIS_SSRS_PPS_SP_SSAS_Hong_Bing Li
SSIS_SSRS_PPS_SP_SSAS_Hong_Bing Li
 
Ssis Ssas Ssrs Sp Pps Hong Bing Li
Ssis Ssas Ssrs Sp Pps Hong Bing LiSsis Ssas Ssrs Sp Pps Hong Bing Li
Ssis Ssas Ssrs Sp Pps Hong Bing Li
 
C:\fakepath\ssis ssas sssrs_pps_hong_bingli_v2003
C:\fakepath\ssis ssas sssrs_pps_hong_bingli_v2003C:\fakepath\ssis ssas sssrs_pps_hong_bingli_v2003
C:\fakepath\ssis ssas sssrs_pps_hong_bingli_v2003
 
Ssis sql hb_li
Ssis sql hb_liSsis sql hb_li
Ssis sql hb_li
 
Ssis sql ssrs_sp_ssas_mdx_hb_li
Ssis sql ssrs_sp_ssas_mdx_hb_liSsis sql ssrs_sp_ssas_mdx_hb_li
Ssis sql ssrs_sp_ssas_mdx_hb_li
 
Self Leadership
Self LeadershipSelf Leadership
Self Leadership
 

Similar to Ssis sql ssrs_sp_hb_li

MMYERS Portfolio
MMYERS PortfolioMMYERS Portfolio
MMYERS Portfolio
Mike Myers
 
Business Intelligence Portfolio
Business Intelligence PortfolioBusiness Intelligence Portfolio
Business Intelligence Portfolio
garyt1953
 
B Woodward Portfolio
B Woodward PortfolioB Woodward Portfolio
B Woodward Portfolio
bwoodward
 
Business Intelligence Portfolio
Business Intelligence PortfolioBusiness Intelligence Portfolio
Business Intelligence Portfolio
guest5a8ee60b
 
ELT Publishing Tool Overview V3_Jeff
ELT Publishing Tool Overview V3_JeffELT Publishing Tool Overview V3_Jeff
ELT Publishing Tool Overview V3_Jeff
Jeff McQuigg
 

Similar to Ssis sql ssrs_sp_hb_li (20)

ReportsDashboardsSql_hbli
ReportsDashboardsSql_hbliReportsDashboardsSql_hbli
ReportsDashboardsSql_hbli
 
ReportsDashboardsSql_hbli
ReportsDashboardsSql_hbliReportsDashboardsSql_hbli
ReportsDashboardsSql_hbli
 
Reports Dashboards SQL Demo
Reports Dashboards SQL DemoReports Dashboards SQL Demo
Reports Dashboards SQL Demo
 
Reports Dashboards ETL SQL_HBLI
Reports Dashboards ETL SQL_HBLIReports Dashboards ETL SQL_HBLI
Reports Dashboards ETL SQL_HBLI
 
ReportsDashboardsSQLDemoHBLI
ReportsDashboardsSQLDemoHBLIReportsDashboardsSQLDemoHBLI
ReportsDashboardsSQLDemoHBLI
 
Reports Dashboards SQL SSIS Demo
Reports Dashboards SQL SSIS DemoReports Dashboards SQL SSIS Demo
Reports Dashboards SQL SSIS Demo
 
BIWorkDemos
BIWorkDemosBIWorkDemos
BIWorkDemos
 
MMYERS Portfolio
MMYERS PortfolioMMYERS Portfolio
MMYERS Portfolio
 
Business Intelligence Portfolio
Business Intelligence PortfolioBusiness Intelligence Portfolio
Business Intelligence Portfolio
 
Business Intelligence Portfolio
Business Intelligence PortfolioBusiness Intelligence Portfolio
Business Intelligence Portfolio
 
Skills Portfolio
Skills PortfolioSkills Portfolio
Skills Portfolio
 
B Woodward Portfolio
B Woodward PortfolioB Woodward Portfolio
B Woodward Portfolio
 
Business Intelligence Portfolio
Business Intelligence PortfolioBusiness Intelligence Portfolio
Business Intelligence Portfolio
 
David Weston SSIS Portfolio
David Weston SSIS PortfolioDavid Weston SSIS Portfolio
David Weston SSIS Portfolio
 
SQL Server 2008 Development for Programmers
SQL Server 2008 Development for ProgrammersSQL Server 2008 Development for Programmers
SQL Server 2008 Development for Programmers
 
Application sql issues_and_tuning
Application sql issues_and_tuningApplication sql issues_and_tuning
Application sql issues_and_tuning
 
ELT Publishing Tool Overview V3_Jeff
ELT Publishing Tool Overview V3_JeffELT Publishing Tool Overview V3_Jeff
ELT Publishing Tool Overview V3_Jeff
 
Optimizing Data Accessin Sq Lserver2005
Optimizing Data Accessin Sq Lserver2005Optimizing Data Accessin Sq Lserver2005
Optimizing Data Accessin Sq Lserver2005
 
A Review of Data Access Optimization Techniques in a Distributed Database Man...
A Review of Data Access Optimization Techniques in a Distributed Database Man...A Review of Data Access Optimization Techniques in a Distributed Database Man...
A Review of Data Access Optimization Techniques in a Distributed Database Man...
 
A Review of Data Access Optimization Techniques in a Distributed Database Man...
A Review of Data Access Optimization Techniques in a Distributed Database Man...A Review of Data Access Optimization Techniques in a Distributed Database Man...
A Review of Data Access Optimization Techniques in a Distributed Database Man...
 

Recently uploaded

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 

Recently uploaded (20)

Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu SubbuApidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 

Ssis sql ssrs_sp_hb_li

  • 2. Slide Contents  3 SQL Server Integration Services (SSIS)  8 SQL Programming  15 SQL Server Reporting Services (SSRS)  18 SharePoint Server This portfolio contains examples of my business intelligence projects using Microsoft BI Product Stack.
  • 4. A new database “All Works” is setup as the staging area for the ETL process. A thorough understanding of the relationships between the tables in the following data diagram is important in determining the sequence of tables to be loaded and in enforcing referential integrity. 4
  • 5. A Script Task is utilized to maintain multiple sets of variables with scripts in C#, for instance, one for keeping track of row counts of data processed dynamically at the folder level, one for row counts at the file level.
  • 6. One SSIS package is created to do ETL for one target table. The following illustrates the data processing within the Job Timesheets package: the data process pipeline starts by extracting data from a CSV file. The data is then conversed, processed and transformed (filter, remove duplicates, lookups, validate) as it passes through the pipeline, and is finally loaded into the target job timesheets table either as inserts or updates. It logs any rows that error out for review and correction. Similarly, seven more packages are generated for seven target tables. 6
  • 7. 7 A Sequence Container is deployed to run the eight ETL packages in sequence based on the relationships between the tables in the “All Works” Database to ensure referential integrity. If the eight packages are processed successfully, data maintenance tasks are performed. A success or failure notice email will be sent out depending on whether the data maintenance tasks are all successfully completed or not. A Master Package is created to contain the Sequence Container, the maintenance tasks and the email notices; then a SQL Server Agent Job is setup to run the Master Package on a predefined schedule to automate the entire data processing procedure.
  • 8. SQL Programming SQL Programming covers a broad range of content: Data Types and Variables, Specialized Functions, Stored Procedures, Control-Of-Flow Operations, Error Handling, Etc. Due to time/space constraints, I will illustrate only some of the relatively new SQL functions/procedures/ programs that I have used in my projects in the following: 1. Data Modification: OUTPUT clause, MERGE, select TOP(with ties) option 2. Aggregation: RANK() OVER (Partition by), GROUPING SETS 3. SQL Functions: PIVOT, CROSS APPLY 4. Common Table Expression (CTE), Correlated and Recursive Queries 5. User Defined Functions (UDF) that returns TABLE type 6. Error Handling Program: Begin Try...End Try Begin Catch...End Catch
  • 9.
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
  • 16. 16
  • 19. Employee Labor Report Deployed to a SharePoint Server
  • 20. configure security settings: give users/ groups appropriate permissions.
  • 21. ---The End--- Hong-Bing Li, February, 2015 Thank you for viewing this presentation!