Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Data transformations. Using kettle transformations - Andriy Kyrylenko,

7 views

Published on

Ruby Meditation #1
February 23, 2013
Kyiv

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Data transformations. Using kettle transformations - Andriy Kyrylenko,

  1. 1. Data transformation. Using kettle transformation ■ Andriy Kyrylenko (Gera-IT) How to manage import files from different vendors? What are the common transformations? How Kettle can help with managing different transformations?
  2. 2. Import records standard feeds NEWS PRODUCTS RSS feed ATOM feed ???
  3. 3. Import products Vendor1 Vendor2 Vendor3 Vendor4 Products1 Products3 Products4 Products2 Shop productsShop
  4. 4. Import products: source and file types FTP HTTP/HTTPS Local file Service API Source file file Records XML file Shop Products DB
  5. 5. Import products: source and file types Source type1 Source type2 Source type3 Service API File format1 File format3 Records File format2 Shop Products DB
  6. 6. Import products: several readers Fieldset1 Fieldset2 FieldsetN Service API Converter1 ConverterN ReaderS Converter2 Shop Products DB
  7. 7. Import products: several ruby classes Fieldset1 Fieldset2 FieldsetN Service API RubyClass1 RubyClassN RubyClassS RubyClass2 Shop Products DB
  8. 8. Converting records: simple cases ■ Filtering fields ■ Filtering records by field value ■ Cloning records ■ Splitting fields into several fields ■ Joining fields ■ Creating new fields ■ Merging two files
  9. 9. Import products: several ruby classes FileSet1 FileSet2 FileSetN Service API Kettle1 KettleN KettleS Kettle2 Shop Products DB http://kettle.pentaho.com
  10. 10. Pentaho Kettle Transformations ■ http://kettle.pentaho.com ■ ■ Download data-integration packager ■ Run ”Spoon” ■ Enjoy

×