5 Minute Intro to Stetl

Just van den Broecke

•

Nov. 08, 2012

• •

Taming Rich GML
with Stetl
Just van den Broecke
5 minute presentation at OSGeo.nl Stammtisch Wageningen
November 7, 2012
w...

We have a
Problem

The Rich GML
Problem

Next SlideShares

Upcoming SlideShare

Stetl for INSPIRE Data Transformation

Stetl for INSPIRE Data Transformation

Loading in …3

×

5 Minute Intro to Stetl

Nov. 08, 2012

• •

Download to read offline

5-minute intro to Stetl an Open Source lightweight framework for handling the conversion and transformation (ETL) of in particular complex/rich GML. Stetl uses and combines existing tools like GDAL/OGR and XSLT. Python is used as glue. Users configure an ETL-process chain through a configuration.
More at http://stetl.org

Just van den Broecke

Open Source Geospatial Professional

5-minute intro to Stetl an Open Source lightweight framework for handling the conversion and transformation (ETL) of in particular complex/rich GML. Stetl uses and combines existing tools like GDAL/OGR and XSLT. Python is used as glue. Users configure an ETL-process chain through a configuration.
More at http://stetl.org

More Related Content

So You Want to Start a Podcast: Finding Your Voice, Telling Your Story, and Building a Community That Will Listen Kristen Meinzer

SAM: One Robot, a Dozen Engineers, and the Race to Revolutionize the Way We Build Jonathan Waldman

From Gutenberg to Google: The History of Our Future Tom Wheeler

Talk to Me: How Voice Computing Will Transform the Way We Live, Work, and Think James Vlahos

The Future Is Faster Than You Think: How Converging Technologies Are Transforming Business, Industries, and Our Lives Peter H. Diamandis

Autonomy: The Quest to Build the Driverless Car—And How It Will Reshape Our World Lawrence D. Burns

No Filter: The Inside Story of Instagram Sarah Frier

Bezonomics: How Amazon Is Changing Our Lives and What the World's Best Companies Are Learning from It Brian Dumaine

Live Work Work Work Die: A Journey into the Savage Heart of Silicon Valley Corey Pein

Future Presence: How Virtual Reality Is Changing Human Connection, Intimacy, and the Limits of Ordinary Life Peter Rubin

Life After Google: The Fall of Big Data and the Rise of the Blockchain Economy George Gilder

Everybody Lies: Big Data, New Data, and What the Internet Can Tell Us About Who We Really Are Seth Stephens-Davidowitz

Understanding Media: The Extensions of Man Marshall McLuhan

The Art of War Sun Tsu

The Victorian Internet: The Remarkable Story of the Telegraph and the Nineteenth Century's On-line Pioneers Tom Standage

Uncommon Carriers John McPhee

The Quiet Zone: Unraveling the Mystery of a Town Suspended in Silence Stephen Kurczy

System Error: Where Big Tech Went Wrong and How We Can Reboot Rob Reich

The Wires of War: Technology and the Global Struggle for Power Jacob Helberg

After Steve: How Apple Became a Trillion-Dollar Company and Lost its Soul Tripp Mickle

Einstein's Fridge: How the Difference Between Hot and Cold Explains the Universe Paul Sen

Dignity in a Digital Age: Making Tech Work for All of Us Ro Khanna

Test Gods: Virgin Galactic and the Making of a Modern Astronaut Nicholas Schmidle

Driven: The Race to Create the Autonomous Car Alex Davies

Second Nature: Scenes from a World Remade Nathaniel Rich

Spooked: The Trump Dossier, Black Cube, and the Rise of Private Spies Barry Meier

A World Without Work: Technology, Automation, and How We Should Respond Daniel Susskind

Lean Out: The Truth About Women, Power, and the Workplace Marissa Orr

Uncanny Valley: A Memoir Anna Wiener

Blockchain: The Next Everything Stephen P. Williams

User Friendly: How the Hidden Rules of Design Are Changing the Way We Live, Work, and Play Cliff Kuang

The Players Ball: A Genius, a Con Man, and the Secret History of the Internet's Rise David Kushner

5 Minute Intro to Stetl

1. Taming Rich GML with Stetl Just van den Broecke 5 minute presentation at OSGeo.nl Stammtisch Wageningen November 7, 2012 www.osgeo.nl www.justobjects.nl
2. We have a Problem
3. The Rich GML Problem
4. Rich GML = Complex Mess
5. INSPIRE BAG BGT Top10NL .
6. The Streetname!
7. Complex Model Transformations
8. Millions of Objects
9. 10s of Millions of <Elements>
10. Multiple Transformation Steps
11. Solution is Spatial ETL
12. A.K.A.
13. ThankYou for your Attention!
14. But... ....FOSS ? ... Stetl...?
15. FOSS ETL - High Level
16. FOSS ETL - Lower Level But Each Powerful by Itself ogr2ogr
17. FOSS ETL - DIY ? (No!)
18. FOSS ETL - How to Combine? =+ + ? ogr2ogr
19. FOSS ETL - Add Python to Equation =+ + ?( ) ogr2ogr
20. =+ + Stetl ( ) ogr2ogr
21. Stetl = Simple Streaming Spatial Speedy ETL
22. Process Chain Input Filter Output gml Filter
23. Speed: Streaming Input Filter Output gml
24. Speed: Going Native Input Filter Output gml ogr2ogr stETL Native C Libs/Progs Calls
25. Example: GML to PostGIS Reader XML Splitter ogr2ogr gml
26. Example: INSPIRE Model Transform ogr2ogr XSLT Writer gml
27. Example: deegree Store ogr2ogr XSLT deegree Writer
28. Process Chain - How? Input Filters Output
29. Example: XML to Shape The Source
30. Example: XML to Shape First: XSLT Transform to GML
31. Example: XML to Shape XML Input XSLT ogr2ogr
32. Example: XML to Shape The Stetl Chain Conﬁg File Process Chain Reader XSLT ogr2ogr
33. ThankYou ! http://stetl.org