Benchmarking the SSIS connectors for Oracle, DB2 and SAPFranck SidiTechnology Architect SQL & BIMicrosoft Israel
Franck SidiMicrosoft – 2004 to NowMicrosoft France – SQL Server PreSales Technical LeaderMigrations SpecialistOracle, Sybase, DB2SAP Integration, BI ArchitectureATG – 2000 to 2004ATG France – PreSales Technical ManagerKeywords : Java, J2EE, Portal, eCommerce, Search, ECM, Mainframe IntegrationSybase – 1994 – 2000 SYBASE INC USA  1999 – 2000 – Senior Developer in charge of PeoplesoftInc and Kenan (Telco Billing ISV)Sybase France  1994 – 1999 – Tech Support Engineer  & Presales Benchmark Specialist (Sybase, Sybase IQ)1993 - Master Degree Database Systems (6 Years at University)Learn on Teradata & Oracle
Session ObjectivesSession Objective(s):  Give overview of the connectivity capabilities with SSIS for Enterprise databases and solutionsOracle, DB2 and SAPGive some quick feedback about Performance capabilities with Oracle DriversTips and Tricks
Data Flow Connectivity OptionsData Flow TaskOLEDBConnectorADO.NETConnectorCustomConnectorOLEDBProviderNativeADO.NETAdapterADO.NETODBCData SourceSpecificInterface/ProtocolODBCData Source Specific Interface/ ProtocolData Storage
SSIS Connectivity for Enterprise Data
DB2
Microsoft OLEDB Provider for DB2Interactive and scriptable Setup programSNA Trace Utility and Trace ViewerTCP/IP network connectionExecution of dynamic SQL commands (DDL and DML), including CALL statement for stored proceduresCustomized Data Link property dialog boxes for creating and modifying file-persisted OLE DB data link files.Supports Integration Services, Replication, Analysis Services, Reporting Services, DQPPackaging and licensingInclude with Microsoft SQL Server 2008 Enterprise and Developer editionsFeature Pack for SQL Server 2008Microsoft download site
Extractingfrom DB2 / AS400Objectives:Extract a single Table with 80 columns and analyze the throughputResults:19 503 Rows / Sec extract from the Development Interface : BI Studio
Almost 3 Times faster than the current solution XXXX
70% faster than YYYYY
Parameters to check :
Defer Prepare to True
Rowset Cache Size
Work with small Buffers : 1 000 RowsLoadinginside DB2 / AS400Objectives:Load inside DB2 / AS400
Use Microsoft OLEDB Driver for DB2 V3 (Pre-release)
V3 includes Bulk Load Capabilities to DB2 / AS400
Results:
1 000 Rows / Sec  with a single load (Normal Mode)to DB2 / AS400
12 000  rows / Secin singleload in Bulk Mode to DB2 / AS400
50 000 rows / Sec  in parallel load in Bulk Mode to DB2 / AS 400TransformationObjectives:Extract 10 336 125 rows from DB2 / AS400 using a single query
Execute 4 Lookups transformation on DB2 to add lookup columns
Execute Global aggregation and generate a flat file with 7 773 702 rowsResults:Execute the global package in 2 Minutes and 24 sec
Execute 4 lookups on DB2 / AS400 Tables
54 000 Rows / Sec Throughput
4 Times Faster than the current solution : XXXXSAP
Extractfrom SAPMicrosoft Connectors SAP R/3 (MYSAP)  et SAP BWTables, Query, BAPI, RFCPartner : Theobald Xtract ISTable (Transparent Tables SAP)Query, BAPI, RFCDelta-QExtractfrom ABAP Programs
Microsoft Connector
TheobaldConnectorReal transaction-secure delta transfer of data
Support of all master and variable data including own generic extractors
No installation in SAP required
All business contents are available immediately even though no application-specific knowledgeOracle Connectivity with Attunity Connectors
Where Attunity Connector for Oracle FitsWherever there is a need for extracting or loading large volumes of Oracle data!
Oracle Connector by Attunity ArchitectureOracleSSISDBOCIOracle Client
Oracle Connector by Attunity Supported platforms & versionsSQL Server 20089.2.0.4 and higherOracleSSISDBOracle ClientAny platformWindows XP 		x86, x64Windows Vista		x86, x64Windows Server 2003	x86, x64, IA64Windows Server 2008	x86, x64, IA64
Requirements	Oracle client software version 10.x or 11.x, on the computer with SSIS. Use 32-bit client on 32 bit platforms, 64-bit on 64-bit platformIf using a 64-bit platforms as a designer client  (i.e.; using BIDS) both 64 and 32-bit clients should be installed.SQL Server 2008  - Enterprise or Developer EditionWindows 2003,2008
Oracle Connector by Attunity High Performance ArchitectureOracle integration (using OCI):Bulk extract source using OCI Array BindingBulk load destination using OCI Direct Path (fastest, constraints must turned off)Incremental Bulk load using OCI Array BindingOracle Connection ManagerSSIS integration:Direct integration into internal buffering APIs, cutting through .NET and other layersOracleSSISDBOCIOracle Client
Oracle connector test setupA generous two-machine configurationSimple SSIS tasks!24 cores @ 2.4 GHz32 GB RAMHP disk array, partitioned  as 17 logical drives64-bit software24 cores @ 2.4 GHz32 GB RAMHP disk array, partitioned  as 17 logical drives64-bit softwareAttunity Oracle connectorsSSIS (SQL Server 2008)Windows Server 2008Oracle 11gWindows Server 2008Flat filesOracle DB1 GB Ethernet

User Group3009

  • 1.
    Benchmarking the SSISconnectors for Oracle, DB2 and SAPFranck SidiTechnology Architect SQL & BIMicrosoft Israel
  • 2.
    Franck SidiMicrosoft –2004 to NowMicrosoft France – SQL Server PreSales Technical LeaderMigrations SpecialistOracle, Sybase, DB2SAP Integration, BI ArchitectureATG – 2000 to 2004ATG France – PreSales Technical ManagerKeywords : Java, J2EE, Portal, eCommerce, Search, ECM, Mainframe IntegrationSybase – 1994 – 2000 SYBASE INC USA 1999 – 2000 – Senior Developer in charge of PeoplesoftInc and Kenan (Telco Billing ISV)Sybase France 1994 – 1999 – Tech Support Engineer & Presales Benchmark Specialist (Sybase, Sybase IQ)1993 - Master Degree Database Systems (6 Years at University)Learn on Teradata & Oracle
  • 3.
    Session ObjectivesSession Objective(s): Give overview of the connectivity capabilities with SSIS for Enterprise databases and solutionsOracle, DB2 and SAPGive some quick feedback about Performance capabilities with Oracle DriversTips and Tricks
  • 4.
    Data Flow ConnectivityOptionsData Flow TaskOLEDBConnectorADO.NETConnectorCustomConnectorOLEDBProviderNativeADO.NETAdapterADO.NETODBCData SourceSpecificInterface/ProtocolODBCData Source Specific Interface/ ProtocolData Storage
  • 5.
    SSIS Connectivity forEnterprise Data
  • 6.
  • 7.
    Microsoft OLEDB Providerfor DB2Interactive and scriptable Setup programSNA Trace Utility and Trace ViewerTCP/IP network connectionExecution of dynamic SQL commands (DDL and DML), including CALL statement for stored proceduresCustomized Data Link property dialog boxes for creating and modifying file-persisted OLE DB data link files.Supports Integration Services, Replication, Analysis Services, Reporting Services, DQPPackaging and licensingInclude with Microsoft SQL Server 2008 Enterprise and Developer editionsFeature Pack for SQL Server 2008Microsoft download site
  • 8.
    Extractingfrom DB2 /AS400Objectives:Extract a single Table with 80 columns and analyze the throughputResults:19 503 Rows / Sec extract from the Development Interface : BI Studio
  • 9.
    Almost 3 Timesfaster than the current solution XXXX
  • 10.
  • 11.
  • 12.
  • 13.
  • 14.
    Work with smallBuffers : 1 000 RowsLoadinginside DB2 / AS400Objectives:Load inside DB2 / AS400
  • 15.
    Use Microsoft OLEDBDriver for DB2 V3 (Pre-release)
  • 16.
    V3 includes BulkLoad Capabilities to DB2 / AS400
  • 17.
  • 18.
    1 000 Rows/ Sec with a single load (Normal Mode)to DB2 / AS400
  • 19.
    12 000 rows / Secin singleload in Bulk Mode to DB2 / AS400
  • 20.
    50 000 rows/ Sec in parallel load in Bulk Mode to DB2 / AS 400TransformationObjectives:Extract 10 336 125 rows from DB2 / AS400 using a single query
  • 21.
    Execute 4 Lookupstransformation on DB2 to add lookup columns
  • 22.
    Execute Global aggregationand generate a flat file with 7 773 702 rowsResults:Execute the global package in 2 Minutes and 24 sec
  • 23.
    Execute 4 lookupson DB2 / AS400 Tables
  • 24.
    54 000 Rows/ Sec Throughput
  • 25.
    4 Times Fasterthan the current solution : XXXXSAP
  • 26.
    Extractfrom SAPMicrosoft ConnectorsSAP R/3 (MYSAP) et SAP BWTables, Query, BAPI, RFCPartner : Theobald Xtract ISTable (Transparent Tables SAP)Query, BAPI, RFCDelta-QExtractfrom ABAP Programs
  • 27.
  • 28.
  • 29.
    Support of allmaster and variable data including own generic extractors
  • 30.
    No installation inSAP required
  • 31.
    All business contentsare available immediately even though no application-specific knowledgeOracle Connectivity with Attunity Connectors
  • 32.
    Where Attunity Connectorfor Oracle FitsWherever there is a need for extracting or loading large volumes of Oracle data!
  • 33.
    Oracle Connector byAttunity ArchitectureOracleSSISDBOCIOracle Client
  • 34.
    Oracle Connector byAttunity Supported platforms & versionsSQL Server 20089.2.0.4 and higherOracleSSISDBOracle ClientAny platformWindows XP x86, x64Windows Vista x86, x64Windows Server 2003 x86, x64, IA64Windows Server 2008 x86, x64, IA64
  • 35.
    Requirements Oracle client softwareversion 10.x or 11.x, on the computer with SSIS. Use 32-bit client on 32 bit platforms, 64-bit on 64-bit platformIf using a 64-bit platforms as a designer client (i.e.; using BIDS) both 64 and 32-bit clients should be installed.SQL Server 2008 - Enterprise or Developer EditionWindows 2003,2008
  • 36.
    Oracle Connector byAttunity High Performance ArchitectureOracle integration (using OCI):Bulk extract source using OCI Array BindingBulk load destination using OCI Direct Path (fastest, constraints must turned off)Incremental Bulk load using OCI Array BindingOracle Connection ManagerSSIS integration:Direct integration into internal buffering APIs, cutting through .NET and other layersOracleSSISDBOCIOracle Client
  • 37.
    Oracle connector testsetupA generous two-machine configurationSimple SSIS tasks!24 cores @ 2.4 GHz32 GB RAMHP disk array, partitioned as 17 logical drives64-bit software24 cores @ 2.4 GHz32 GB RAMHP disk array, partitioned as 17 logical drives64-bit softwareAttunity Oracle connectorsSSIS (SQL Server 2008)Windows Server 2008Oracle 11gWindows Server 2008Flat filesOracle DB1 GB Ethernet