Your SlideShare is downloading. ×
Task Factory - Pragmatic Works
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Introducing the official SlideShare app

Stunning, full-screen experience for iPhone and Android

Text the download link to your phone

Standard text messaging rates apply

Task Factory - Pragmatic Works

1,444
views

Published on

SSIS gives you flexibility and power to manage your simple or complex ETL Projects using native SSIS features. But certain things still cannot be accomplished easily or are impossible to perform …

SSIS gives you flexibility and power to manage your simple or complex ETL Projects using native SSIS features. But certain things still cannot be accomplished easily or are impossible to perform without extensive knowledge of programming. Task Factory is a collection of essential, high-performance components and tasks for SSIS that eliminate the need for programming. Using Task Factory can increase productivity and can give you a much higher level of performance.


0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
1,444
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
8
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Task FacTory | Product overview
  • 2. SSiS gives you flexibility and power to manage your simple or complex etL Projects using native SSiS features. But certain things still cannot be accomplished easily or are impossible to perform without extensive knowledge of programming. task Factory is a collection of essential, high-performance components and tasks for SSiS that eliminate the need for programming. using task Factory can increase productivity and can give you a much higherKey Features level of performance. Upsert Destination (Bulk Update/Insert) SalesForce Source and Destination XML Destination Secure FTP Task (Upload/Download/Delete) Sharepoint Source and Destination Zip Compression Task PGP File Encryption Task Advanced Email Task (Supports HTML/SMTP and Placeholders) Data Validation Transformation Email Source (Process emails in DataFlow) Address Parse Transform (Validate and Standardize US Mailing Addresses, Detect Quality) High performance Dimension Merge SCD Transform (Formally known as KimballSCD) Error Description Transformation RegX Replace Transformation Text Standardization Transformation NULL Handling Transformation DateFormat Change Transformation Batch Delete and Update Transformation Replace Unwanted Characters Transformation File Properties Task Terminator Destination Please visit pragmaticworks.com/taskfactory to watch videos of TaskFactory features
  • 3. Dimension key Features: merge scD » designed to handled most of the dimension loading scenarios (as per Kimball Method) » Flexible Scd 2 “current row” handling - permits specification of the date in few clicks (e.g. type1 Scd, type2 Scd, “endpoints”. comparatively, the only choice inferred members) with the MS Scd wizard is to have the “expiry” date be NuLL to signify the current » Supports very large dimensions (Several record. millions rows) » Flexible Scd 2 date handling - permits » 100x faster than native Microsoft Scd specification of what date expired and component new rows get marked with. the Scd » cleaner and Non-destructive mechanism wizard leaves that up to a derived column unlike native Microsoft Scd component component that will get destroyed when which destorys down stream components the wizard is run again to adjust other when you re-run MS Scd wizard. properties. » inbuilt Surrogate Key management » options to use other data types for the » “Special” (unknown) member support, per current Member and inferred Member Kimball Method best practices. columns - not just Boolean types as in the Scd wizard. » includes a “row change reason” output column on all (except unchanged) outputs, » Supports “retiring” dimension members per Kimball Method best practices. that have been deleted from the Source System by marking their “expiry date” with » Supports simple and advanced styles of a real date. row Auditing for inserts and updates, per Kimball Method best practices. key Features: salesForce. » easily retrieve the data stored in your » Query can use variables as parameters (e.g. com source salesforce.com account with a few simple where datecreate = <@vardatecreated>) clicks. » *Must have an enterprise salesforce. » SoQL (SalesForce query language) can be com account to use this task. this is a edited in the ui salesforce.com requirement.salesForce.com key Features: DesTinaTion » with this component you will be able to very easily add data from your system into » *Must have an enterprise salesforce. com account to use this task. this is a your salesforce.com account with very little salesforce.com requirement. configuration. » the easy to use ui allows mapping of columns from your data to columns in the salesforce.com the SSiS Sharepoint Source brings the key Features: sharepoinT functionality of consuming data from » easily retrieves sharepoint list and view data source a Sharepoint Service to SSiS. with an stored on a sharepoint server integrated Sharepoint cAML Builder the » can use windows or password SSiS Sharepoint Source Adapter in task authentication Factory is the quickest and easiest way » optional integrated query builder builds to retrieve data from Sharepoint List. cAML queries quickly and easily » Preview window display the data that will be retrieved during execution » connections support proxy servers | 3 | TaskFactory Product overview Please visit pragmaticworks.com/taskfactory to watch videos of TaskFactory features
  • 4. sharepoinT the Sharepoint List destination Adapter » can use windows or password DesTinaTion allows users to quickly connect to their authentication SSiS packages to sharepoint servers to » easy to use column mapper makes it send data to lists. easy to see what data will be sent to the sharepoint list key Features: » connections support proxy servers » easily sends data to a sharepoint list from an SSiS package Supports inserts, updates or deletesXml DesTinaTion the XML destination allows the user the » the order in which the column data is (v2.0) export source data to an XML File. exported can be fully customized. key Features: Formatting options: » the name of the column can be customized » encoding options are utF-8, utF-16, utF- to output any name needed instead of the 32 or Ascii column name from the source » the xml header can be included or left out » column data can be exported as an of the xml file attribute, element, element with cdAtA or » data can be exported on one single line or element with XML data formatted with a newline after each row, » Null data can be handled by exporting an indenting each row and element, adding a empty xml element / attribute, ignoring the newline after each attribute attribute / element or replacing the null A preview of the exported file is viewable from data with a custom value. the ui upserT user selects to compare. if the data in the Helps synchronize two systems no DesTinaTion matter the source or destination. selected columns does not match, the (BaTch upDaTe Many companies struggle with the update will be performed. otherwise it will be ignored. or inserT) development of loading procedures that DaTeTime compare - updates will only determine whether the row is new or to be performed based on a datetime column be updated. the upsert destination reads being compared from the source to a the rows coming into the data flow and column in the destination. detects if the row should be inserted or TimesTamp compare - updates will updated. this saves the developer a long only be performed based on a timestamp development cycle and could save up to column being compared from the source to 90% on each execution of a package. a column in the destination. key Features: » currently supports SQL 2005 and SQL 2008 as destination » conditionally inserts or updates data into a table. inserts are performed using bulk » easy to use user interface insert which is significantly faster compared to row-by-row approach. there are four methods in which data can be updated Data Load test (2.5 Million Rows) giving the user a great amount of control on whether data should be updated or not. WITHoUT Bulk upDaTe - updates will be performed UPSERT in the fastest amount of time because no data compare is performed. this is by far Time the fastest way to perform updates 4.5 minuTe WITH column compare - updates will only UPSERT be performed based on what columns the 5 seconDs | 4 | TaskFactory Product overview Please visit pragmaticworks.com/taskfactory to watch videos of TaskFactory features
  • 5. secure FTp Task Brings encrypted security to FtP within » Supports SSH, implicit SFtP and explicit SFtP SSiS. Many companies transmit files using FtP as a transmission method for » Supports HttP, SocKS4, SocKS4a and highly sensitive files. the task Factory SocKS5 proxies Secure FtP task will allow you to » Supports all actions provided by native FtP transmit files over most common secure task channels to your partners safely. » easy to use user interface Key Features: » used to interact with a secure ftp site compressionTask (Zip or unZip) compresses or decompresses a file or directory. Many companies struggle with transmitting files larger than 1 GB. our compression task will compress files within SSiS by up to 90%, allowing greater speed and less network space. key Features: » used to compress and decompress files Compression test (File Size: 2 GB) and directories BEFoRE » Supports the use of Zip, Bz2, and GZip CoMPRESSIoN compression algorithms » Supports creating a self-extracting eXe size » Supports password protected zip files 2 gB AFTER CoMPRESSIoN » easy to use user interface 180 mB pgp encrypTion Task the PGP task brings easy to use pgp » File signing - the PGP task can sign a file to allow an end user / system to be able encryption, decryption, file signing and to verify the file being sent was actually verification to SSiS that is based on created your system. openPGP. technology. » File veriFicaTion - the PGP task can key Features: verify the signature of a file sent to your » File encrypTion - the PGP task can system from a client. this will allow you to encrypt a file that can be sent securely verify the file actually was created by the increasing the security available around client and not hacked by something else transporting files through FtP and email. and sent to your system. » File DecrypTion - the PGP task can be used to decrypt a file sent to your system. aDDress parse TransForm Key Features: Used to parse unformatted address data into USPS standardized address data. | 5 | TaskFactory Product overview Please visit pragmaticworks.com/taskfactory to watch videos of TaskFactory features
  • 6. email source key Features: » reads email from a mailbox into a data flow » there is full support for filtering messages based on sender, message to, subject, date » Supports iMAP/PoP3 received, body and priority. » Support most email providers (including GMAiL)DaTa valiDaTion Acts as a gatekeeper for your data. Many key Features: TransForm companies receive questionable data » validates data from a source with the use of from various sources, causing a myriad regular expressions of production problems and inconsistent » validates email, Phone number, SSN and reporting. the data validation transform many other patterns verifies that your data is clean prior to » regular expression editor included as part insertion. rows that are suspicious are of the ui flagged for later removal or additional » outputs the results of the data check in business rules. each row of the transform output. » easy to use user interfaceFile properTies Task reads the properties of any file and stores property in variable. Many space by identifying old files ready for archive. companies receive large data files from key Features: outside their organizations and run » used to read the properties of an existing the risk of loading the file prematurely file. during transmission causing an SSiS » will read the properties like File exists, failure. our File Properties task gives File Size, File Name, File content, creation you the power to eliminate this problem time, is File in use, Hidden, readonly and by determining if the file is in use or assign them to SSiS package level variables transmitted before loading. the File » easy to use user interface Properties task additionally saves drivesurrogaTe key TransForm key Features: » Adds an identifier column to a data flow used to uniquely identify a row. this is useful if your data source does not contain an identifier or you simply want to add a row counter to your data flow. » Allows the use of a variable to determine seed and increment DeleTe BaTch TransForm key Features: » the delete batch transform allows you to easily delete data in a table without writing any sql statements and then continue on with the other tasks in the data flow. | 6 | TaskFactory Product overview Please visit pragmaticworks.com/taskfactory to watch videos of TaskFactory features
  • 7. upDaTe BaTch key Features: TransForm » the update batch transform allows you to easily update data in a table without writing any sql statements and then continue on with the other tasks in the data flow. aDvanceD key Features:email anD sms » Sends emails from within an SSiS package Task through SMtP » inbuilt HtML editor for HtML email » Supports sending SMS messages » template based email (template can be external file, variable, or direct input) » Allows use of user/System variables as placeholders in the email body so variables can be automatically replaced when email is sent. TerminaTor DesTinaTion key Features: » this free component allows you to quickly add a destination to your package without any configuration. » this is useful when developing your ssis packages and want to quickly add a destination without having to configure a flat file destination or any other destination that will eventually be deleted. DaTa cleansing key Features: TransForm » used to cleanse data from a source by applying cleansing rules to the data. » the data cleansing task has 16 built in algorithms that allow you to clean data without any programming or sql updates. | 7 | TaskFactory Product overview Please visit pragmaticworks.com/taskfactory to watch videos of TaskFactory features
  • 8. replace unwanTeD the replace unwanted characters transform allows the user to remove » Predefined set of characters (alpha, numeric, alpha numeric)characTers Task unwanted characters or words from » custom characters or words to be removed (v2.0) source data » the replaced data can be outputted to the key Features: same column in the transform or a new output column. » two options available to be used to replace unwanted characters null hanDler TransForm the null handler transform allows the 1. replace Blank value with user defined (v2.0) user to replace null or blank values from value their source data with a user defined 2. replace Blank value with user defined value (e.g. replace null with empty string value or vice versa) 3. replace Blank value with Null value key Features: » the replaced data can be outputted to the » three actions available to handle null or same column in the transform or a new blanks values output column. regeX replace TransForm the regex replace transform allows the are three capture groups in that regular (v2.0) user to define a regular expression to expression and you could use $1, $2, $3 either replace (with user defined value) to extract the area code, prefix and line or extract data from a source column number. » the second action allows the user to define key Features: a regular expression to extract data from » there are two actions that can be used with the source column. there are several this transform. options when using this action including » the first action is to replace regex matched extracting capture groups, separating data with a user defined value. this option multiple values by a delimiter and providing allows for the use of capture groups to be a “no match” value. part of the replace value. For instance if the regular expression was for a phone » the replaced data can be outputted to the number it would look like something like same column in the transform or a new “(d{3})[-).s]?(d{3})[-).s]?(d{4})”. there output column. error ouTpuT DescripTion the error output description allows the data that caused a failure but withTransForm (v2.0) the user to connect error outputs to it the error output description the user can from sources and transforms and get see not only the exact error but the row descriptions on why the particular row data that caused the error. failed. Normally the user is unable to see | 8 | TaskFactory Product overview Please visit pragmaticworks.com/taskfactory to watch videos of TaskFactory features
  • 9. Trim plusTransForm the trimPlus transforms provides a - trim all trailing whitespace characters way for users to trim either whitespace (v2.0) or user defined characters from the - trim all leading whitespace characters » Specified character trim actions – Allows beginning and end of source columns the user to defined the character(s) to be key Features: trimmed from the source column data - trim specified characters from start and there are 6 actions provided to trim end characters - trim specified characters from start » whitespace trim actions – trims whitespace from column data - trim specified characters from end - trim all trailing and leading whitespace characters caseTransForm the case transforms provided a way to properly case, upper case or lowercase all the (v2.0) text in a source column there is a single action which is “convert string to Proper case” but there are many styles in which the data can be properly cased data. the styles are: key Features: » simplepropercase – capitalize the First » TiTle – capitalize the First Letter of each Letter of each word (reference file is not word, convert Symbols used so its very fast but no symbol/word - text_in : (c) PrAGMAticworKS, replacement is performed like other styles) iNcorPorAted - text_in : the cow jumped over the MooN - text_out: © Pragmatic works, inc - text_out: the cow Jumped over the » senTence – capitalize the First Letter of Moon each Sentence » name – Standardize Prefixes & Suffixes - text_in : tASKFActorY(tm) iS A - text_in : Mr / MrS JoHN vAN der trAdeMArK oF PrAGMAticworKS cAMP PHd iNc. - text_out: Mr and Mrs John van der - text_out: taskFactory™ is a trademark of camp, Ph. d. Pragmatic works inc. » aDDress –eliminate conflict Between » uppercase – capitalize each letter in the Street Suffix & city / State / Zip column data - text_in : 1234 Se 41St ct APt 26e (ct is - text_in : hi, this is task factory. also the abbreviation for connecticut) - text_out: Hi, tHiS iS tASK FActorY. - text_out: 1234 Se 41st ct, Apt. 26e » lowercase – Lowercase each letter in the » csZ (ciTy sTaTe Zip) – Avoid confusion column data Between “company” & “colorado” - text_in : Hi, this is task tactory » text_in : PiNe, co 80470 - text_out: hi, this is task factory. » text_out: Pine, co 80470 | 9 | TaskFactory Product overview Please visit pragmaticworks.com/taskfactory to watch videos of TaskFactory features
  • 10. 400 college dr., Suite 216Middleburg, FL 32068(904) 638-5743support@pragmaticworks.comsales@pragmaticworks.comwww.pragmaticworks.com