5 Minute Intro to Stetl

1,561 views

Published on

5-minute intro to Stetl an Open Source lightweight framework for handling the conversion and transformation (ETL) of in particular complex/rich GML. Stetl uses and combines existing tools like GDAL/OGR and XSLT. Python is used as glue. Users configure an ETL-process chain through a configuration.
More at http://stetl.org

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,561
On SlideShare
0
From Embeds
0
Number of Embeds
14
Actions
Shares
0
Downloads
5
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

5 Minute Intro to Stetl

  1. 1. Taming Rich GMLwith StetlJust van den Broecke5 minute presentation at OSGeo.nl Stammtisch WageningenNovember 7, 2012www.osgeo.nlwww.justobjects.nl
  2. 2. We have aProblem
  3. 3. The Rich GMLProblem
  4. 4. Rich GML = Complex Mess
  5. 5. INSPIREBAGBGTTop10NL.
  6. 6. The Streetname!
  7. 7. ComplexModelTransformations
  8. 8. MillionsofObjects
  9. 9. 10s of Millionsof<Elements>
  10. 10. MultipleTransformationSteps
  11. 11. Solution isSpatial ETL
  12. 12. A.K.A.
  13. 13. ThankYoufor yourAttention!
  14. 14. But.......FOSS ? ... Stetl...?
  15. 15. FOSS ETL - High Level
  16. 16. FOSS ETL - Lower LevelBut Each Powerful by Itselfogr2ogr
  17. 17. FOSS ETL - DIY ? (No!)
  18. 18. FOSS ETL - How to Combine?=+ + ?ogr2ogr
  19. 19. FOSS ETL - Add Python to Equation=+ + ?( )ogr2ogr
  20. 20. =+ +Stetl( )ogr2ogr
  21. 21. Stetl=SimpleStreamingSpatialSpeedyETL
  22. 22. Process ChainInput Filter OutputgmlFilter
  23. 23. Speed: StreamingInput Filter Outputgml
  24. 24. Speed: Going NativeInput Filter Outputgmlogr2ogr stETLNative C Libs/ProgsCalls
  25. 25. Example: GML to PostGISReaderXMLSplitterogr2ogrgml
  26. 26. Example: INSPIRE Model Transformogr2ogr XSLT Writergml
  27. 27. Example: deegree Storeogr2ogr XSLTdeegreeWriter
  28. 28. Process Chain - How?Input Filters Output
  29. 29. Example: XML to ShapeThe Source
  30. 30. Example: XML to ShapeFirst: XSLT Transform to GML
  31. 31. Example: XML to ShapeXMLInputXSLT ogr2ogr
  32. 32. Example: XML to ShapeThe Stetl Chain Config FileProcessChainReaderXSLTogr2ogr
  33. 33. ThankYou !http://stetl.org

×