Using Spatial ETL for Web Services-Based Data Sharing Don Murray - Safe Software Inc.
Overview What is Spatial ETL? Spatial ETL Supported Formats Spatial ETL Enabling Services Based Data Sharing Top 5 List of Spatial ETL and web services? Conclusion Slide
What is Spatial ETL?
What is Spatial ETL? E xtract T ransform L oad
Extract
Extract
Transform
Transform Restructure data models and schemas Geometry – surfaces, solids, meshes, CSGs, b-reps Attributes - schemas Coordinate systems and projections Textures Single/double precision
Transform Integrate data from  multiple  sources into a single data model and new output format Example: Raster + Vector + CAD = 3D Data Model
Load
Load Make the data available where, when and how it is needed. One time data loading Automated data processing On-the-fly web access
Spatial ETL Brings Data to Applications
Spatial ETL In Action
Spatial ETL Supported Data Circa 1995 Slide  Spatial ETL
Spatial ETL Supported Data  Circa 2009 Slide
Spatial ETL Data Sources
ESRI JSON GeoRSS/RSS Feed GeoJSON GML  KML * (Google Earth/ ArcGIS Explorer,…) OGC WFS, WMS, WCS, CSW, … Common GeoWeb Formats/Protocols
Common GeoWeb Applications ArcGIS Explorer Bing Maps Google Earth/ Maps OpenLayers Twitter, WKTweet (and other Social Networking Apps)
How Spatial ETL enables Services-Based Data Sharing  Slide
#1 – Spatial ETL Behind the Scenes Slide  Database loading
#1 – Spatial ETL Behind the Scenes Slide  Raster Tile Generation
#2 – Spatial ETL and Data Download You choose the front-end! ArcGIS Server  Integration Google Maps Integration Slide
#3 – Spatial ETL and Data Validation Slide
#3 – Spatial ETL and Data Validation Slide  Problem Utility workers are out during the day collecting data. Historically data validation is done overnight. Data issues means another trip to the site.
#3 – Spatial ETL and Data Validation Slide  Solution Spatial ETL Server technology enables users to validate data from the field.
#4 - Spatial ETL and MetaData Problem As more data becomes available on the web metadata becomes more important. Spatial ETL and MetaData Metadata is simply another type of data for Spatial ETL Technology Solution Use Spatial ETL Technology to publish data and associated metadata to the web. Use Spatial ETL technology to retrieve metadata and data.
#5 Spatial ETL Consuming Web Services Problem: The number of web services is growing quickly. Spatial ETL makes it easy to leverage services in your applications.
Spatial ETL for fun! Data Streaming Problem Celebrities are the single biggest threat to our children today.   We need to keep these people away from our children.
Spatial ETL for Fun!  Data Streaming Resources We bought them all nice fashionable ankle bracelets which they love! What they don’t know is that the purse has an embedded GPS device! Solution Use Spatial ETL to deliver location data to users!
Simple Real World Data Streaming
Conclusion Spatial ETL is about moving data so that users can exploit power of other tools Transformation is the key.  Deliver information needed not just raw data. Spatial ETL plays both a consumer and supporting role for web services.  Slide
Thanks for your attending! For more info visit  www.safe.com Or contact me  Don Murray Email: [email_address] Twitter:  donatsafe Blog: blog.safe.com

Spatial ETL For Web Services-Based Data Sharing

  • 1.
    Using Spatial ETLfor Web Services-Based Data Sharing Don Murray - Safe Software Inc.
  • 2.
    Overview What isSpatial ETL? Spatial ETL Supported Formats Spatial ETL Enabling Services Based Data Sharing Top 5 List of Spatial ETL and web services? Conclusion Slide
  • 3.
  • 4.
    What is SpatialETL? E xtract T ransform L oad
  • 5.
  • 6.
  • 7.
  • 8.
    Transform Restructure datamodels and schemas Geometry – surfaces, solids, meshes, CSGs, b-reps Attributes - schemas Coordinate systems and projections Textures Single/double precision
  • 9.
    Transform Integrate datafrom multiple sources into a single data model and new output format Example: Raster + Vector + CAD = 3D Data Model
  • 10.
  • 11.
    Load Make thedata available where, when and how it is needed. One time data loading Automated data processing On-the-fly web access
  • 12.
    Spatial ETL BringsData to Applications
  • 13.
  • 14.
    Spatial ETL SupportedData Circa 1995 Slide Spatial ETL
  • 15.
    Spatial ETL SupportedData Circa 2009 Slide
  • 16.
  • 17.
    ESRI JSON GeoRSS/RSSFeed GeoJSON GML KML * (Google Earth/ ArcGIS Explorer,…) OGC WFS, WMS, WCS, CSW, … Common GeoWeb Formats/Protocols
  • 18.
    Common GeoWeb ApplicationsArcGIS Explorer Bing Maps Google Earth/ Maps OpenLayers Twitter, WKTweet (and other Social Networking Apps)
  • 19.
    How Spatial ETLenables Services-Based Data Sharing Slide
  • 20.
    #1 – SpatialETL Behind the Scenes Slide Database loading
  • 21.
    #1 – SpatialETL Behind the Scenes Slide Raster Tile Generation
  • 22.
    #2 – SpatialETL and Data Download You choose the front-end! ArcGIS Server Integration Google Maps Integration Slide
  • 23.
    #3 – SpatialETL and Data Validation Slide
  • 24.
    #3 – SpatialETL and Data Validation Slide Problem Utility workers are out during the day collecting data. Historically data validation is done overnight. Data issues means another trip to the site.
  • 25.
    #3 – SpatialETL and Data Validation Slide Solution Spatial ETL Server technology enables users to validate data from the field.
  • 26.
    #4 - SpatialETL and MetaData Problem As more data becomes available on the web metadata becomes more important. Spatial ETL and MetaData Metadata is simply another type of data for Spatial ETL Technology Solution Use Spatial ETL Technology to publish data and associated metadata to the web. Use Spatial ETL technology to retrieve metadata and data.
  • 27.
    #5 Spatial ETLConsuming Web Services Problem: The number of web services is growing quickly. Spatial ETL makes it easy to leverage services in your applications.
  • 28.
    Spatial ETL forfun! Data Streaming Problem Celebrities are the single biggest threat to our children today.  We need to keep these people away from our children.
  • 29.
    Spatial ETL forFun! Data Streaming Resources We bought them all nice fashionable ankle bracelets which they love! What they don’t know is that the purse has an embedded GPS device! Solution Use Spatial ETL to deliver location data to users!
  • 30.
    Simple Real WorldData Streaming
  • 31.
    Conclusion Spatial ETLis about moving data so that users can exploit power of other tools Transformation is the key. Deliver information needed not just raw data. Spatial ETL plays both a consumer and supporting role for web services. Slide
  • 32.
    Thanks for yourattending! For more info visit www.safe.com Or contact me Don Murray Email: [email_address] Twitter: donatsafe Blog: blog.safe.com

Editor's Notes

  • #4 38 2 1
  • #5 38 2 1
  • #6 38 2 1
  • #7 38 2 1
  • #8 38 2 1
  • #11 38 2 1
  • #14 Use this to explain what spatial ETL is – it helps connect the spatial data that is stored out there in many formats and systems with the applications and users that need them.