Using Spatial ETL for Web Services-Based Data Sharing Don Murray - Safe Software Inc.

Overview What is Spatial ETL? Spatial ETL Supported Formats Spatial ETL Enabling Services Based Data Sharing Top 5 List of Spatial ETL and web services? Conclusion Slide

What is Spatial ETL?

Spatial ETL Supported Formats

Spatial ETL Enabling Services Based Data Sharing

Top 5 List of Spatial ETL and web services?

Conclusion

What is Spatial ETL?

What is Spatial ETL? E xtract T ransform L oad

E xtract

T ransform

L oad

Extract

Extract

Transform

Transform Restructure data models and schemas Geometry – surfaces, solids, meshes, CSGs, b-reps Attributes - schemas Coordinate systems and projections Textures Single/double precision

Restructure data models and schemas

Geometry – surfaces, solids, meshes, CSGs, b-reps

Attributes - schemas

Coordinate systems and projections

Textures

Single/double precision

Transform Integrate data from multiple sources into a single data model and new output format Example: Raster + Vector + CAD = 3D Data Model

Integrate data from multiple sources into a single data model and new output format

Example: Raster + Vector + CAD = 3D Data Model

Load

Load Make the data available where, when and how it is needed. One time data loading Automated data processing On-the-fly web access

Make the data available where, when and how it is needed.

One time data loading

Automated data processing

On-the-fly web access

Spatial ETL Brings Data to Applications

Spatial ETL In Action

Spatial ETL Supported Data Circa 1995 Slide Spatial ETL

Spatial ETL Supported Data Circa 2009 Slide

Spatial ETL Data Sources

ESRI JSON GeoRSS/RSS Feed GeoJSON GML KML * (Google Earth/ ArcGIS Explorer,…) OGC WFS, WMS, WCS, CSW, … Common GeoWeb Formats/Protocols

ESRI JSON

GeoRSS/RSS Feed

GeoJSON

GML

KML * (Google Earth/ ArcGIS Explorer,…)

OGC WFS, WMS, WCS, CSW, …

Common GeoWeb Applications ArcGIS Explorer Bing Maps Google Earth/ Maps OpenLayers Twitter, WKTweet (and other Social Networking Apps)

ArcGIS Explorer

Bing Maps

Google Earth/ Maps

OpenLayers

Twitter, WKTweet (and other Social Networking Apps)

How Spatial ETL enables Services-Based Data Sharing Slide

#1 – Spatial ETL Behind the Scenes Slide Database loading

#1 – Spatial ETL Behind the Scenes Slide Raster Tile Generation

#2 – Spatial ETL and Data Download You choose the front-end! ArcGIS Server Integration Google Maps Integration Slide

You choose the front-end!

ArcGIS Server Integration

Google Maps Integration

#3 – Spatial ETL and Data Validation Slide

#3 – Spatial ETL and Data Validation Slide Problem Utility workers are out during the day collecting data. Historically data validation is done overnight. Data issues means another trip to the site.

Problem

Utility workers are out during the day collecting data.

Historically data validation is done overnight.

Data issues means another trip to the site.

#3 – Spatial ETL and Data Validation Slide Solution Spatial ETL Server technology enables users to validate data from the field.

Solution

Spatial ETL Server technology enables users to validate data from the field.

#4 - Spatial ETL and MetaData Problem As more data becomes available on the web metadata becomes more important. Spatial ETL and MetaData Metadata is simply another type of data for Spatial ETL Technology Solution Use Spatial ETL Technology to publish data and associated metadata to the web. Use Spatial ETL technology to retrieve metadata and data.

Problem

As more data becomes available on the web metadata becomes more important.

Spatial ETL and MetaData

Metadata is simply another type of data for Spatial ETL Technology

Solution

Use Spatial ETL Technology to publish data and associated metadata to the web.

Use Spatial ETL technology to retrieve metadata and data.

#5 Spatial ETL Consuming Web Services Problem: The number of web services is growing quickly. Spatial ETL makes it easy to leverage services in your applications.

Spatial ETL for fun! Data Streaming Problem Celebrities are the single biggest threat to our children today.  We need to keep these people away from our children.

Problem

Celebrities are the single biggest threat to our children today. 

We need to keep these people away from our children.

Spatial ETL for Fun! Data Streaming Resources We bought them all nice fashionable ankle bracelets which they love! What they don’t know is that the purse has an embedded GPS device! Solution Use Spatial ETL to deliver location data to users!

Resources

We bought them all nice fashionable ankle bracelets which they love!

What they don’t know is that the purse has an embedded GPS device!

Solution

Use Spatial ETL to deliver location data to users!

Simple Real World Data Streaming

Conclusion Spatial ETL is about moving data so that users can exploit power of other tools Transformation is the key. Deliver information needed not just raw data. Spatial ETL plays both a consumer and supporting role for web services. Slide

Spatial ETL is about moving data so that users can exploit power of other tools

Transformation is the key. Deliver information needed not just raw data.

Spatial ETL plays both a consumer and supporting role for web services.

Thanks for your attending! For more info visit www.safe.com Or contact me Don Murray Email: [email_address] Twitter: donatsafe Blog: blog.safe.com

Thanks for your attending!

For more info visit www.safe.com

Or contact me

Don Murray

Email: [email_address]

Twitter: donatsafe

Blog: blog.safe.com