WhereCampPDX Keynote

Flash Player 9 (or above) is needed to view presentations.
We have detected that you do not have it on your computer. To install it, go here.

more share options
Embed For WordPress.com

Without related presentations

Notes on slide 1

ESRI can’t open may of the data sharing standards that are becoming prevalent on the GeoWeb such as SpatiaLite, Atom and KML.

Standards organizations
“The ESRI Standard”

Standards organizations are based on consensus.
They are slow to adjust to changes in the marketplace.
Follow don’t lead.
GeoJSON, GeoRSS, KML, SpatiaLite are all examples

Shapefiles are interop friendly right?

You start with the 3 amigos
Add on some projection info and some metadata
Then throw on some crazy ESRI index stuff that you may need

So you zip up the shapefile....

* .sbn and .sbx — a spatial index of the features
* .fbn and .fbx — a spatial index of the features for shapefiles that are read-only
* .ain and .aih — an attribute index of the active fields in a table or a theme's attribute table
* .ixs — a geocoding index for read-write shapefiles
* .mxs — a geocoding index for read-write shapefiles (ODB format)
* .atx — an attribute index for the .dbf file in the form of shapefile.columnname.atx (ArcGIS 8 and later)
* .shp.xml — metadata in XML format
* .cpg — used to specify the code page (only for .dbf) for identifying the character encoding to be used

Shapefiles are interop friendly right?

The elephant in the room

To access FGDB, you need ArcObjects

Which besides licensing, you need to work with this

We need an open spatial database

SQLite
If it is good enough for these guys

It is good enough for this guy

PostGIS and SQL Server 2008 support OGC SF SQL as well

Community needs to drive new GIS standards.

GeoJSON, GeoRSS are perfect examples. ESRI supports them.

ESRI created their layer package just to solve this problem.
Zip file (like KMZ)
FGDB + ESRI Layer Symbology
ESRI handler to automatically unzip and add to ArcMap

Styled Layer Descriptor/Symbology Encoding

All community driven standards.
No OGC
Proprietary GIS support

There are three types of spatial data

How do you make sure that people can find your data when they need it most?

People will pay for quality data when it is easy to do so.
So much information is locked up behind doors because there is no way for people to monezite it.
Give RSP Architects example of design studies

The key takeaway from this is that the community will build maps on their own, even if you provide them.
What you need to do is offer up your data in consumable formats such as GeoRSS, GeoJSON, KML, SpatiaLite so that the community can incorporate your data into these projects.

How does one share a huge spatial database?
Talk about sharing GeoTIFF and MrSID

Lets take one of the more popular vector GIS datasets - TIGER
It is bigger than a small Honda Civic: 125 GB

Downloading TIGER is a huge PITA

You can get down to the county, but sometimes that is too much data.
San Bernardino County in California is larger than Massachusetts, Connecticut, Rhode Island, and Delaware combined.
LA County would be a member of the G20.

You have to download each county at a time which takes a long time.
You have to download each county in each state!

Truly open data formats allow users freedom of using the best software packages to get their work done.

I’m looking at you FGDB

We are seeing better data catalogs with generally open spatial data formats.
They are still tied back into the old ways of sharing (FTP, Whole File Downloads)

Archiving geo data is as important as sharing.

American had fallen in love with Dharma and Greg

Needless to say the project was a critical success.

The project was stored in my personal data warehouse (a cd in the bottom of my drawer)

My old computer with VB5, FoxPro and MapObjects 1.2 has been recycled

Favorites, Groups & Events

WhereCampPDX Keynote - Presentation Transcript

Data Interoperability on the GeoWeb James Fee Evangelist
If Sharing is Easy... http://www.ﬂickr.com/photos/13586721@N05/3122021735/
Why is it so hard to share spatial data?
What about spatial data standards?
Community Driven Standards
Just give me a shapeﬁle
portland.shp portland.shx portland.dbf
portland.shp portland.shx portland.dbf portland.prj portland.shp.xml
portland.cpg portland.shp portland.atx portland.sbx portland.shx portland.sbn portland.dbf portland.ain portland.aih portland.prj portland.mxs portland.ixs portland.shp.xml
portland.cpg portland.shp portland.atx portland.sbx portland.shx portland.sbn portland.dbf portland.ain portland.aih portland.prj portland.mxs portland.ixs portland.shp.xml
Can We Come Up With a Standard?
What would work?
What would work? open database
What would work? open database open symbology
What would work? open database open symbology OGC support
What would work? open database open symbology OGC support platform support
ESRI’s File Geodatabase
ESRI’s File Geodatabase
So just give me a File Geodatabase
So we need an open spatial database format
I really want to get me some of that!
‣ All the beneﬁts of Shapeﬁles ‣ Open ‣ Easy to use
‣ All the benefits of Shapefiles ‣ Open ‣ Easy to use ‣ None of the limitations ‣ Multiple files ‣ Limited field widths
Problems with SQLite?
Problems with SQLite? •No support from ESRI
Problems with SQLite? •No support from ESRI •Still not well known in the community
SpatiaLite
SpatiaLite •Built on SQLite RDBMS
SpatiaLite •Built on SQLite RDBMS •Just a ﬁle
SpatiaLite •Built on SQLite RDBMS •Just a ﬁle •Portable - Works on Windows, Linux or Mac OS X
SpatiaLite •Built on SQLite RDBMS •Just a ﬁle •Portable - Works on Windows, Linux or Mac OS X •Implements OGC Simple Features for SQL
Community Driven Standards
Community Driven Standards Users drive formats
How do we share?
Layer Package to the Rescue
Layer Package to the Rescue
What Works for the Layer Package
What Works for the Layer Package •Compressed format shares well
What Works for the Layer Package •Compressed format shares well •Includes symbology
What Works for the Layer Package •Compressed format shares well •Includes symbology •Metadata and preview thumbnails
What Works for the Layer Package •Compressed format shares well •Includes symbology •Metadata and preview thumbnails •Easy to create with ArcMap
Problems with the Layer Package
Problems with the Layer Package •Uses the closed ESRI Layer ﬁle for symbology
Problems with the Layer Package •Uses the closed ESRI Layer ﬁle for symbology •Some ﬁles converted to closed File Geodatabase format
Problems with the Layer Package •Uses the closed ESRI Layer ﬁle for symbology •Some ﬁles converted to closed File Geodatabase format •Undocumented
We need symbology with our datasets
Options:
Options: SLD/SE
Options: SLD/SE CSS
Put my symbology in a sidecar!
portland.sqlite portland.css
Atom, GeoRSS, GeoJSON
Atom, GeoRSS, GeoJSON SQLite Spatial SpatiaLite CSS for Symbology
Making data discoverable
Spatial Data Can Be
Spatial Data Can Be Secure Sensitive Open
Availability During Disasters
Monetize Where Possible
Picking Formats and Target Audience
Picking Formats and Target Audience Photo used under creative commons from dotbenjamin
Picking Formats and Target Audience Photo used under creative commons from dotbenjamin
Citizen Participation San Diego Fires
Sharing Large Datasets
Sharing Large Datasets
Sharing Large Datasets
Sharing Large Datasets
So what about vectors?
So what about vectors?
So what about vectors?
So what about vectors? 125 GB
Selecting Vectors to Download 1.Zoom to your area of interest 2.Draw polygon for selection 3.Query
Vectors in WeoGeo
Vectors in WeoGeo Com ing Soo n!
What does data interoperability give us?
Breaking Through Stacks
Closed formats should be avoided
Archiving Geo Data
How Will People Use Your Data in 10 years?
It Was 1998...
James was coding up some cutting edge ESRI MapObjects and FoxPro Magic
Data Archival Systems: 1999
My Old Computer is Dead
If only I had archived in a non-proprietary format...
Ways to keep this from happening to with your data... Use Open Formats Use ETL Pray
Fight for your right to use open spatial data standards
Thank You James Fee email: jfee@weogeo.com twitter: @cageyjames blog: http://www.spatiallyadjusted.com mobile: 480.225.2287