SSIS components such as Flow Task, Container and priority constraints become important parts in conducting ETL Processes, Explanation of SSIS architecture, Control Flow and Data Flow are the main topics in this presentation

1. BATAM | 23 OCT 2019
Kiki Rizki Noviandi | Data Platform MVP

2. ABOUT ME
Microsoft Data Platform MVP Since 2006
Founder SQL Server Indonesia User Group Community
My Name : Kiki Rizki Noviandi
Milis : sqlserver-indo@yahoogroups.com
https://www.facebook.com/groups/sqlserverindonesia
http://www.kwad5.com
https://mvp.microsoft.com/en-us/PublicProfile/33869?fullName=Kiki%20Rizki%20Noviandi

3. SSIS ARCHITECTURE

4. INTRODUCTION
SQL Server Integration Services (SSIS) is an ETL tool (Extract,
Transform and Load) which is used for building enterprise-level data
integration and data transformation solutions. Integration services
help in developing solutions for complex business problems, as listed
below
Copying or downloading files
Sending e-mail messages in response to events
Updating DataWarehouses
Cleaning and mining data
Managing SQL server objects and data

5. SSIS ARCHITECTURE
Control Flow
Data Flow

6. CONTROL FLOW
 When first viewing a package…gives a view of what’s supposed to happen 
 Tasks (such as a data flow task, script task, send mail, FTP)
 Precedence constraints
 Containers
 Separate Engine than the Data Flow engine

7. EXAMPLE CONTROL FLOW

8. DATA FLOW
The Data Flow task encapsulates the data flow engine
that moves data between sources and destinations, and
lets the user transform, clean, and modify data as it is
moved.
Microsoft Books Online:
https://docs.microsoft.com/en-us/sql/integration-services/control-
flow/data-flow-task

9. TYPICAL DATA FLOW TASK
 Source(s)
Extract data
 Transformation
Modify, route, cleanse,
summarize data
 Destinations
Load data

10. LOTS OF OPTIONS

11. PACKAGES
An organized collection of connections, control flow elements,
data flow elements, event handlers, variables, parameters, and
configurations which are assembled using either the graphical
design tools that SQL Server Integration Services provides, or
build programmatically.

12. CONTENTS OF A PACKAGE
Tasks and Containers (Control Flow)
Data Sources and Destination (Data Flow)
Connection Managers (connections)

13. PACKAGE FUNCTIONALITY EXTENSION
OBJECTS
Configurations
A configuration is a set of
property-value pairs that defines
the properties of the package
and its tasks, containers,
variables, connections and
event handlers when the
Logging and Log Providers
A log is a collection of information that is
collected when the package runs
Variables
Integration services supports
system variables and user-
defined variables

14. TOUR OF THE “DEV” ENVIRONMENT

15. DEMO
LAUNCH SSDT
CREATE A NEW SSIS PROJECT
TOUR THE VARIOUS WINDOW PANES

16. CONTROL FLOW BASICS

17. CONTROL FLOW ELEMENTS
 Tasks
 Containers
 Precedence Constraints

18. FREQUENTLY USED
CONTROL FLOW TASKS
Data Profiling Task
“hunt for treasure and landmines”
Execute SQL Task
File System Task
Execute Process Task
Send Mail Task
Execute Package Task
Script Task
Data Flow Task
The “star of the opera”

19. CONTROL FLOW CONTAINERS
 Why Containers?
 Containing / organizing
 Executable unit within the package
 Can be enabled/disabled
 Two of the three containers provide Looping
 Transaction protection context
 Think “all, or nothing”
 Checkpoint context
 Restart point
 Three Kinds
 Sequence Container
 For Loop Container
 For Each Loop Container

20. PRECEDENCE CONSTRAINTS
 Precedence Constraints define:
 Workflow order
 Workflow conditions
 Downstream Task & Container Execution can be based on:
 Constraint evaluation
 Success
 Failure
 Completion
 Expression
 Expression and Constraint
 Expression or Constraint
 Multiple Constraint evaluation
 Logical AND
 Logical OR

21. DATA FLOW BASICS

22. DATA FLOW BASICS
 Various ways to accomplish ETL in SSIS
 BULK INSERT Task
 Execute SQL Task
 bcp.exe
 Command line utility for importing and exporting text files
 Most typically used ETL tool in SSIS is the Data Flow Task
 The “DFT” defines a “pipeline”
 At least one source
 At least one destination
 Optional: one or more transformations

23. DATA FLOW SOURCES
 Database Engines
 OLE-DB Source
 ADO .NET Source
 ODBC
 File sources
 Flat file
 Excel file
 Raw file
 XML file
 Others (pretty much anything)

24. DATA FLOW DESTINATIONS
 Database Engines
 OLE-DB destination
 ADO .NET destination
 File destinations
 Flat file
 Excel file
 Raw file
 Other destinations
 ODBC destination
 Recordset destination
 …

25. DATA FLOW TRANSFORMATIONS
 Row transformations
 Character map
 Copy column
 Derived column
 Import column / Export column
 Rowset transformations
 Aggregate
 Sort
 Pivot and Unpivot
 Row sampling and Precentage sampling
 Split & join transformations
 Conditional Split
 Lookup
 Merge
 Merge Join
 Multicast
 Union All
Auditing transformations
Audit
Row count
BI transformations
Slowly changing dimension
Fuzzy grouping
Fuzzy lookup
Data mining query
Custom transformations
Script component

26. QUESTION ?

27. THANK YOU