What is ETL?
Extract is the process of reading data from a database
Transform is the process of converting the extracted data from its
previous form into the form it needs to be in so that it can be placed
into another database. Transformation occurs by using rules or
lookup tables or by combining the data with other data
Load is the process of writing the data into the target database
Terms closely related and managed by
Different ETL tools
•Pentaho Data Integration -Kettle Project (open source ETL)
•SAS ETL studio
•Business Objects Data Integrator (BODI)
•Microsoft SQL Server Integration Services (SSIS)
Talend Open Studio for Data Integration
Hortonworks Sandbox VM
What are supported data input formats?
What kinds of datasets can be loaded?
Talend Studio offers nearly comprehensive connectivity to:
Packaged applications (ERP, CRM, etc.), databases, mainframes, files, Web Services, and so on to
address the growing disparity of sources.
Data warehouses, data marts, OLAP applications - for analysis, reporting, dashboarding,
scorecarding, and so on.
Built-in advanced components for ETL, including string manipulations, Slowly Changing
Dimensions, automatic lookup handling, bulk loads support, and so on.
Data volumes are growing exponentially
Data velocity is moving faster
As information systems grow in complexity, the disparity of
sources is growing as well
All these target structures have different data transformation
requirements and different tolerances in terms of latency
Transformations involved in ETL processes can be highly complex