What is Parallel Processing ? Where Parallel Processing can be use ? SSIS and BI SSIS vs SQL Stored Procedure SSIS and Parallel Processing How to do SSIS Parallel Processing ? DEMO Off Topic –How to use Auto Test Script for Review and Testing Comparison of all with Time New Innovation –Parallel Processing with Continuous Serial Threading Question, Files and Links

1. SSIS Parallel Processing

2. About Me - Vishal Pawar
• 8 + years of experience in Microsoft BI Stack
• Microsoft BI Solution Architect in The Most Group
• BI Consulting partner of Right Click Info
• Professional Microsoft BI Trainer at Mentalist Network
• NMUG Community Leader , Speaker
• Microsoft Community Representative for Navi Mumbai region.
• SQL PASS Chapter Lead for Mumbai & Navi Mumbai
• MCTS: Microsoft® Certified Technology Specialist -SQL Server
2008,Business Intelligence Development and Maintenance
• MCSA: Microsoft® Certified Solutions Associate
• CSM: Certified Scrum Master from Scrum Alliance, US
• SQL Server Expert and 3 Complex SQL tool innovator on Codplex
• BE-Computer Science & Engineering , RAIT , Mumbai Univercity
• MBA-Information System, Arianth College , Pune
• Blogging @ http://bimentalist.com , http://sqlmentalist.com
• BI Articles :: 350+ , SQL Article – 400+, SQL Script – 350+

3. What is Parallel Processing ?
3
Where Parallel Processing can be use ?
SSIS and BI
SSIS vs SQL Stored Procedure
3
4
Presentation Agenda
3
2
1
SSIS and Parallel Processing
How to do SSIS Parallel Processing ?
DEMO
Off Topic – How to use Auto Test Script for Review and Testing
5
6
7
8
Comparison of all with Time9
New Innovation – Parallel Processing with Continuous Serial Threading10
3
3
Question, Files and Links
11

4. What is Parallel Processing ?

5. Serial processing
P1
TASK 1
P2P3P4
TASK 2
TASK 3
TASK 4
At t1
At t2
At t3
At t4
Serial Processing

6. Parallel Processing
P1P2P3P4
TASK 2TASK 3TASK 4
At t1
At t2
TASK 2

7. Where Parallel Processing can be use ?
Can we use Parallel Processing to read text file
C++ Code - http://www.cplusplus.com/reference/cstdio/fread/

8. SSIS and Parallel Processing

9. Kick of Parallel Process to save time

10. Architecture diagram of SQL server

11. SQL Server 2014 and Parallelism
Will see this when
we have SQL 2014

12. SSIS Architecture & Parallels

13. SSIS and BI
MS BI
Implementation
SSIS
60%
SSRS
25%
SSAS
15%

14. SSIS vs SQL Stored Procedure
Performance Features/capabilities Current skill set
Complexity Extensibility
Architecture of
sources
Data Quality
Checking
ETL Framework Development Time

15. How Banner Fact Calculation doable in SSIS Parallel Processing ?
Develop SQL Statement to
Run Only One Survey ID
Develop SQL Statement to
Run Only One Survey ID
Develop SQL Statement to
Run Only One Survey ID
Develop SQL Statement to
Run Only One Survey ID
P1P2P3P4
Develop SQL Statement to
Run Only One Survey ID

16. DEMO

17. How Scale Mean Score doable in SSIS Parallel Processing ?
Develop SQL Statement to
Run Only One Survey ID
Develop SQL Statement to
Run Only One Survey ID
Develop SQL Statement to
Run Only One Survey ID
Develop SQL Statement to
Run Only One Survey ID
P1P2P3P4
Develop SQL Statement to
Run Only One Survey ID
All Scale mean Calculation
But not required as we
can calculate this using
Response Matrix
Calculation

18. Off Topic – How to use Auto Test Script for Review and Testing

19. Testing Possibilities and Expertise !

20. Example of SQL Test Script & Review of Parallel Stats
Create Automated Test Script Create Review Test Script
1 2
DEMO
Valid N Count
Test
Banner Fact
Count Test

21. New Innovation – Parallel Processing with
Continuous Serial Threading
P1P2P3P4
TASK 2TASK 3TASK 4
At t1
At t2
TASK 2
Batch Of Parallel Processor
Parallel Processing with Continuous Serial Threading

22. Show me Real Stats !

23. Parallel Processing with Continuous Serial Threading Stats

24. Comparison of all with Time
SP with SQL JOB
SP with Paralleled SQL JOB
SSIS in SQL JOB
SSIS in SQL JOB
SSIS with SP in SQL JOB
SSIS Parallel Processing With SQL JOB
SSIS Parallel Processing With SP With SQL JOB
SSIS Parallel Processing With Serial Threading SP With SQL JOB
SSIS Parallel Processing With CLR With Serial Threading SP With SQL JOB
SQL 2014-SSIS Parallel With CLR With Serial Threading SP With SQL JOB

25. Question, PPT and Visio Files and Links
• SSIS – An Inside View Part 4
• SSIS Nugget: Engine Threads
• Improving the Performance of the Data
Flow
• Designing Your SSIS Packages for
Parallelism (SQL Server Video)
• Too Many Sources in a Data Flow
• SSIS Operational and Tuning Guide
• What Is Parallel Execution In SSIS, How Many
Tasks A SSIS Package Can Execute In Parallel?
• SSIS How to Process Data as Fastest, Parallel ,
Multithreaded or in Very Efficient Way !!!