SQL Server Integration Services

SQL Server integration services

What is it?
Microsoft’s ETL solution bundled with SQL Server
E – Extract
T – Transform
L – Load
Destination
Source
Write
Read
SSIS

Demo
A simple ETL Demo

Demo
You can get a little crazy...

Confusion reigns!

Reasons Not Consider SSIS
Performance
Consider SQL or BCP for simple imports
File system performance
Data Latency
SSIS is not a near real time solution
SOA, ESB, B2B Integration
No business rules support
Very basic queue support
XML support limited

Reasons To Consider SSIS
Merging Data from Heterogeneous Data Stores
Populating Data Warehouses
Cleaning and Standardizing Data
Building Business Intelligence into a Data Transformation Process
Automating Administrative Functions and Data Loading

What’s New in 2008
Lookup transformation performance improvements and new caching options
ADO.NET Source and destination components
Data profiling task and viewer
Wizard interface for defining source and destination
Scripts (for the Script Transform) are now done in Visual Studio and thus in .NET languages.
New package format
Three new data formats for working with times

x64 Limitations
Command line tools (dtexec, dtutil) cannot co-exist with 32bit versions.
No DTS support.
Limitations on data providers – No Access, Excel or SQL Compact
IA64 has more limitations including no designer support

Demo
Running in 32bit on 64bit!

What to Watch Out For?
RecordSet Destination
SLOW (5 times than a raw file!)
Memory
SSIS is an in memory process.
SELECT *
Exceptionally bad in SSIS
Use many small packages
Comments!!!
Understand the components
Many do the same things in different ways with different trade offs
Lookup vs. Merge Join or Execute SQL vs. Execute T-SQL
Understand which components run asynchronously and which run synchronously

Parallelism Example

Storage: Files or Servers
Details http://www.sqljunkies.com/WebLog/knight_reign/archive/2005/05/05/13523.aspx

References
http://www.microsoft.com/technet/prodtechnol/sql/2005/technologies/ssisperfstrat.mspx
http://ssisblog.replicationanswers.com/2008/01/04/when-to-not-use-ssis--directory--file-iterations.aspx
http://marcusrosen.blogspot.com/2008/04/sql-server-2005-integration-service.html
http://www.eggheadcafe.com/software/aspnet/32465151/linked-servers-versus-ssi.aspx
http://blogs.conchango.com/jamiethomson/archive/2006/06/28/SSIS_3A00_-Comparing-performance-of-a-raw-file-against-a-recordset-destination.aspx
http://www.microsoft.com/technet/prodtechnol/sql/2005/ssisperf.mspx

http://www.slideshare.net	24
http://www.sadev.co.za	12

SQL Server Integration Services

by Robert MacLean on Dec 02, 2009

Accessibility

Categories

Tags

Upload Details

Usage Rights

2 Embeds 36

Statistics

SQL Server Integration Services — Presentation Transcript