The document discusses SQL Server Integration Services (SSIS), an Extract, Transform, Load (ETL) tool. It covers key SSIS concepts like packages, control flow, data flow, tasks, containers, variables, parameters and event handling. It also discusses best practices for performance, debugging, testing, deployment and administration of SSIS packages.

1. By Rahul Singh

2.  The product can extract, transform,
and load (ETL) data astonishingly fast
 The one consistent skill needed in today’s
technical job market is ETL
 A core component of SSIS is the notion of a
package.

3.  Control Flow -The brain of a package is its
Control Flow
 Control Flow tasks few example:
1. Data Flow Task
2. File System Task
3. Execute SQL Task

4.  Precedence constraints are package
components that direct tasks to execute in a
given order.
 3 possible outcome values
1. Success
2. Completion
3. Failure

5.  Containers are core units in the SSIS architecture
for grouping tasks together logically into units
of work.
 Few examples of containers would be
1. For Loop Container:
2. Foreach Loop Container:

6.  The core strength of SSIS is its capability to
extract data into the server’s memory,
transform it, and write it out to an alternative
destination
 If the Control Flow is the brains of SSIS, then
the Data Flow would be its heart

7.  Sources : eg-OLEDB sources Sql server , oracle
 Transformations : eg-Aggregate , Audit
 Destinations: eg- OLE DB Destination, Flat File
Destination

8.  Variables are another vital component of the
SSIS architecture.
 Parameters behave much like variables but
with a few main exceptions. Parameters, like
variables can make a package dynamic

9.  Below events can be track
 OnError
 OnPostValidate
 OnProgress
 OnWarning

10.  Programs can be written in VB and c# and then called from
script task
 C#
 Public partial class ScriptMain
 {
 ...
 public void Main()
 {
 System.Windows.Forms.MessageBox.Show(GetFileName("b
ankfile", "txt"));
 Dts.TaskResult = (int)ScriptResults.Success;
 }

12.  Creating Connections
 Creating the Control Flow
 Creating the Data Flow
 Completing the Package
 Saving the Package
 Executing the Package

13.  Knowledge Base Management
 Data Quality Projects
 Administration

14. Master data management (MDM) is the process
an organization goes through to discover and
define data with the ultimate goal of compiling a
master list of data.

15.  SQL Server Change Data Capture
 CDC task in SSIS tasks
 CDC tasks require preparation

17.  Data warehousing and BI is about reporting
and analytics
 Data profiling is the process of analyzing the
source data to better understand its condition
in terms of cleanliness, patterns, number of
nulls, and so on

18.  Excel and MS Access
 Oracle
 XML and Web Services:
 Flat Files
 ODBC

19.  Checkpoint – gives an option to restart from
middle in case of failure
 Package Transactions –if single task fails entire
package can be rolled back or not are
configurable using package transaction

20.  Limit synchronous processes
 Monitor the memory use of blocking and semi-
blocking transformations
 Reduce staging and disk I/O
 Reduce reliance on an RDBMS

21.  ETL tasks can be included as part of a product
backlog
 Packages can be assigned to developers
 Packages can be checked into source control
through the file system or through Visual
Studio
 Packages can be grouped together and
deployed as a set

22.  Building the Source Component using VB or
C#
 Building the Transformation Component
 Building the Destination Adapter

23.  Package Configuration
 Using Command line commands DTExec
 SSIS CATOLOG – Store metadata and logs
 Managing Security
 Scheduling Packages