Foss4g evolution-gis-data

Joachim Van der Auwera
Joachim Van der AuweraSoftware Developer / Architect at PROGS
Evolution of GIS data booth # 12 By Joachim Van der Auwera
Who am I ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
ev·o·lu·tion  ? ,[object Object],[object Object],[object Object],[object Object],[object Object]
Use cases ,[object Object]
Use cases ,[object Object],start editing finish editing other users other users
Use cases ,[object Object]
Use cases ,[object Object]
Use cases, challenges ,[object Object],[object Object],[object Object]
Solutions
Possible solutions Workflow solution Long lasting transactions Editing layers Timestamp based data versioning Revision based data versioning
Use cases ,[object Object],Workflow solution ✗ n/a Long lasting transactions ✗ Editing layers ✗ Timestamp based data versioning ✓ Revision based data versioning ✓
Use cases ,[object Object],start editing finish editing other users other users Workflow solution ✗ n/a Long lasting transactions ✓ Editing layers ✓ Timestamp based data versioning ✓ Revision based data versioning ✓
Use cases ,[object Object],Workflow solution ✓ Long lasting transactions ✗ Editing layers ✓ Timestamp based data versioning ✓ Revision based data versioning ✓
Use cases ,[object Object],Workflow solution ✓ Long lasting transactions ✗ Editing layers ✓ Timestamp based data versioning ✗ Revision based data versioning ✓
Use cases & solutions, overview Workflow solution n/a n/a ✓ ✓ Long lasting transactions ✗ ✓ ✗ ✗ Editing layers ✗ ✓ ✓ ✓ Timestamp based data versioning ✓ ✓ ✓ ✗ Revision based data versioning ✓ ✓ ✓ ✓
Workflow solutions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Versioned data ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Spatial database solutions database native data versioning ? extensions or plug-ins ? PostGis no * (timetravel, geoserver) Oracle Spatial yes Flashback DB2 yes (DB2 10) MySQL no * MS SQL yes Change Data Capture
Do it yourself ,[object Object],[object Object],[object Object]
Simple versioning, timestamp ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Better versioning, RCS-like ,[object Object],[object Object],[object Object]
Step back ,[object Object],[object Object],[object Object],[object Object],unhappy about standards Build custom solution Converge to common / popular standardize
Integration ,[object Object],[object Object],[object Object]
Questions? Thanks! ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Illustrations ,[object Object],[object Object],[object Object],[object Object],[object Object]
1 of 25

Recommended

ETL Testing Overview by
ETL Testing OverviewETL Testing Overview
ETL Testing OverviewChetan Gadodia
3K views20 slides
ETL Testing - Introduction to ETL testing by
ETL Testing - Introduction to ETL testingETL Testing - Introduction to ETL testing
ETL Testing - Introduction to ETL testingVibrant Event
201 views25 slides
Blogger presentation for ITEC 830 by
Blogger presentation for ITEC 830Blogger presentation for ITEC 830
Blogger presentation for ITEC 830vangtria
349 views11 slides
Visual vocab by
Visual vocabVisual vocab
Visual vocabbeausost
244 views13 slides
Visual vocab by
Visual vocabVisual vocab
Visual vocabbeausost
269 views13 slides
It infrastructure management by
It infrastructure managementIt infrastructure management
It infrastructure managementShoaib Patel
1.1K views6 slides

More Related Content

Viewers also liked

食物做成的風景 by
食物做成的風景 食物做成的風景
食物做成的風景 sandy
306 views20 slides
地震知識-生命三角[1].. by
地震知識-生命三角[1]..地震知識-生命三角[1]..
地震知識-生命三角[1]..sandy
401 views51 slides
Mapping, GIS and geolocating data in Java @ JAX London by
Mapping, GIS and geolocating data in Java @ JAX LondonMapping, GIS and geolocating data in Java @ JAX London
Mapping, GIS and geolocating data in Java @ JAX LondonJoachim Van der Auwera
1K views61 slides
免洗筷的可怕 by
免洗筷的可怕免洗筷的可怕
免洗筷的可怕sandy
2.5K views22 slides
Securing GIS data by
Securing GIS dataSecuring GIS data
Securing GIS dataJoachim Van der Auwera
1.8K views13 slides
Erp failure at heashy chocolates by
Erp failure at heashy chocolatesErp failure at heashy chocolates
Erp failure at heashy chocolatesShoaib Patel
803 views11 slides

Viewers also liked(20)

食物做成的風景 by sandy
食物做成的風景 食物做成的風景
食物做成的風景
sandy306 views
地震知識-生命三角[1].. by sandy
地震知識-生命三角[1]..地震知識-生命三角[1]..
地震知識-生命三角[1]..
sandy401 views
免洗筷的可怕 by sandy
免洗筷的可怕免洗筷的可怕
免洗筷的可怕
sandy2.5K views
Erp failure at heashy chocolates by Shoaib Patel
Erp failure at heashy chocolatesErp failure at heashy chocolates
Erp failure at heashy chocolates
Shoaib Patel803 views
Successfull implementation of technology by Shoaib Patel
Successfull implementation of technologySuccessfull implementation of technology
Successfull implementation of technology
Shoaib Patel195 views
South_Blakey_Evolution of GIS Based Analysis ECIM Haugesund 2010 by Bernie South
South_Blakey_Evolution of GIS Based Analysis ECIM Haugesund 2010South_Blakey_Evolution of GIS Based Analysis ECIM Haugesund 2010
South_Blakey_Evolution of GIS Based Analysis ECIM Haugesund 2010
Bernie South526 views
GIS in Geography by aatkinson7
GIS in GeographyGIS in Geography
GIS in Geography
aatkinson71.5K views
On the evolution of gis and the spatial enabling of information armando gue... by Armando Guevara
On the evolution of gis and the spatial enabling of information   armando gue...On the evolution of gis and the spatial enabling of information   armando gue...
On the evolution of gis and the spatial enabling of information armando gue...
Armando Guevara1.8K views
Data Models - GIS I by John Reiser
Data Models - GIS IData Models - GIS I
Data Models - GIS I
John Reiser7.7K views
raster data model by Riya Gupta
raster data modelraster data model
raster data model
Riya Gupta4.9K views
Vectors vs Rasters, Graphic Formats by premysl
Vectors vs Rasters, Graphic FormatsVectors vs Rasters, Graphic Formats
Vectors vs Rasters, Graphic Formats
premysl6.4K views
Gis powerpoint by kaushdave
Gis powerpointGis powerpoint
Gis powerpoint
kaushdave22.2K views
Effects of relevant contextual features in the performance of a restaurant re... by Blanca Alicia Vargas Govea
Effects of relevant contextual features in the performance of a restaurant re...Effects of relevant contextual features in the performance of a restaurant re...
Effects of relevant contextual features in the performance of a restaurant re...

Similar to Foss4g evolution-gis-data

NetWeaver Data Management process by
NetWeaver Data Management processNetWeaver Data Management process
NetWeaver Data Management processTony de Thomasis
534 views11 slides
Porting Spring PetClinic to GigaSpaces by
Porting Spring PetClinic to GigaSpacesPorting Spring PetClinic to GigaSpaces
Porting Spring PetClinic to GigaSpacesUri Cohen
986 views19 slides
Scalar unstructured data april 28, 2010 by
Scalar unstructured data april 28, 2010Scalar unstructured data april 28, 2010
Scalar unstructured data april 28, 2010pwtoday
556 views55 slides
Oracle migrations and upgrades by
Oracle migrations and upgradesOracle migrations and upgrades
Oracle migrations and upgradesDurga Gadiraju
805 views18 slides
CS 542 Parallel DBs, NoSQL, MapReduce by
CS 542 Parallel DBs, NoSQL, MapReduceCS 542 Parallel DBs, NoSQL, MapReduce
CS 542 Parallel DBs, NoSQL, MapReduceJ Singh
1.8K views50 slides
ScalabilityAvailability by
ScalabilityAvailabilityScalabilityAvailability
ScalabilityAvailabilitywebuploader
721 views42 slides

Similar to Foss4g evolution-gis-data(20)

Porting Spring PetClinic to GigaSpaces by Uri Cohen
Porting Spring PetClinic to GigaSpacesPorting Spring PetClinic to GigaSpaces
Porting Spring PetClinic to GigaSpaces
Uri Cohen986 views
Scalar unstructured data april 28, 2010 by pwtoday
Scalar unstructured data april 28, 2010Scalar unstructured data april 28, 2010
Scalar unstructured data april 28, 2010
pwtoday556 views
Oracle migrations and upgrades by Durga Gadiraju
Oracle migrations and upgradesOracle migrations and upgrades
Oracle migrations and upgrades
Durga Gadiraju805 views
CS 542 Parallel DBs, NoSQL, MapReduce by J Singh
CS 542 Parallel DBs, NoSQL, MapReduceCS 542 Parallel DBs, NoSQL, MapReduce
CS 542 Parallel DBs, NoSQL, MapReduce
J Singh1.8K views
ScalabilityAvailability by webuploader
ScalabilityAvailabilityScalabilityAvailability
ScalabilityAvailability
webuploader721 views
Disaster Recovery for Big Data by Carlos Izquierdo at Big Data Spain 2017 by Big Data Spain
Disaster Recovery for Big Data by Carlos Izquierdo at Big Data Spain 2017Disaster Recovery for Big Data by Carlos Izquierdo at Big Data Spain 2017
Disaster Recovery for Big Data by Carlos Izquierdo at Big Data Spain 2017
Big Data Spain1.8K views
Stat 5.4 Pre Sales Demo Master by reachtimsq
Stat 5.4 Pre Sales Demo MasterStat 5.4 Pre Sales Demo Master
Stat 5.4 Pre Sales Demo Master
reachtimsq1.1K views
The Practice of Presto & Alluxio in E-Commerce Big Data Platform by Alluxio, Inc.
The Practice of Presto & Alluxio in E-Commerce Big Data PlatformThe Practice of Presto & Alluxio in E-Commerce Big Data Platform
The Practice of Presto & Alluxio in E-Commerce Big Data Platform
Alluxio, Inc.91 views
Building Analytic Apps for SaaS: “Analytics as a Service” by Amazon Web Services
Building Analytic Apps for SaaS: “Analytics as a Service”Building Analytic Apps for SaaS: “Analytics as a Service”
Building Analytic Apps for SaaS: “Analytics as a Service”
Understanding System Performance by Teradata
Understanding System PerformanceUnderstanding System Performance
Understanding System Performance
Teradata4.5K views
SQL Server Modernization by Gianluca Hotz
SQL Server ModernizationSQL Server Modernization
SQL Server Modernization
Gianluca Hotz176 views
Enterprise-level Transition from SAS to Open-source Programming for the whole... by Kevin Lee
Enterprise-level Transition from SAS to Open-source Programming for the whole...Enterprise-level Transition from SAS to Open-source Programming for the whole...
Enterprise-level Transition from SAS to Open-source Programming for the whole...
Kevin Lee17 views
7 Stages of Scaling Web Applications by David Mitzenmacher
7 Stages of Scaling Web Applications7 Stages of Scaling Web Applications
7 Stages of Scaling Web Applications
David Mitzenmacher103.7K views

Foss4g evolution-gis-data

  • 1. Evolution of GIS data booth # 12 By Joachim Van der Auwera
  • 2.
  • 3.
  • 4.
  • 5.
  • 6.
  • 7.
  • 8.
  • 10. Possible solutions Workflow solution Long lasting transactions Editing layers Timestamp based data versioning Revision based data versioning
  • 11.
  • 12.
  • 13.
  • 14.
  • 15. Use cases & solutions, overview Workflow solution n/a n/a ✓ ✓ Long lasting transactions ✗ ✓ ✗ ✗ Editing layers ✗ ✓ ✓ ✓ Timestamp based data versioning ✓ ✓ ✓ ✗ Revision based data versioning ✓ ✓ ✓ ✓
  • 16.
  • 17.
  • 18. Spatial database solutions database native data versioning ? extensions or plug-ins ? PostGis no * (timetravel, geoserver) Oracle Spatial yes Flashback DB2 yes (DB2 10) MySQL no * MS SQL yes Change Data Capture
  • 19.
  • 20.
  • 21.
  • 22.
  • 23.
  • 24.
  • 25.

Editor's Notes

  1. Welcome to this talk about the evolution of GIS data. I will first introduce myself. I am jvda, a technical guy (some would say a “nerd”). My career in user oriented programming began more than 20 years ago. Half of which was as an open source proponent, using Java. Focus on enterprise software, and I always seem to end up worrying about code quality and maintainability, build environment and tooling, strong architecture, consistence, documentation, ease of programming. Joined Geosparc and the GIS world in August 2009 Part of the three headed dragon which leads Geomajas development.
  2. dictionary.com gives 9 meanings for evolution, a couple of which are displayed on the slide.. For the scope of this talk, I will focus on the fact that data in GIS systems in usually not static. It has to change because of changes in the real world. This has implications both on the data and data storage and the management of the data. Let us consider a couple of use-cases.
  3. Probably the most straightforward case is to be able to display the data which was current a a specific moment in time, whether this is now, last week, or in the case shows, more than 200 years ago.
  4. Another case is making changes which take a long time. Maybe they are complex, or there is a coffee break, or you have to rush home to get the kids from school and continue the day after. You don't want people to see the features halfway of your editing, you only want the end result to be public.
  5. A more complex variant of the previous case is that the changes may also need to be verified and approved by someone else. You see a work-flow of two people, one doing the editing (bottom), and one doing the checking.
  6. There are two areas, data management and data storage. For the management, there are workflow or business process modelling and execution solutions. These are typically for the interaction of different parties and/or servers. Secondly thereare the options for data storage. ...
  7. Postgresql TimeTravel is deprecated Geoserver, gt2-postgis-versioned modules, opengeo DB2 : since june 2010, on time SELECT AVG(SALARY) FROM EMP SYSTEM VERSIONS AS OF '2009-06-13-00:00:00:000000000000' WHERE deptno = 'SW1 MySQL: DDEngine.org http://www.mysqlconf.com/mysql2009/public/schedule/detail/6205
  8. Let's step back a little. The first relational database, ADABAS was released in 1970. Youw wrist watch is probably more powerful than the mainframes of that time. Especially storage space, both in memory and on disk was “scarce”. There was no space to keep historic data and just having the current state was already revolutionary. Of couse the data did change, so transactions were introduced to assure data consistency. These days storage is “cheap”, so should we still write software applying restrictions from 4 decades ago?
  9. Let's step back a little. The first relational database, ADABAS was released in 1970. Youw wrist watch is probably more powerful than the mainframes of that time. Especially storage space, both in memory and on disk was “scarce”. There was no space to keep historic data and just having the current state was already revolutionary. Of couse the data did change, so transactions were introduced to assure data consistency. These days storage is “cheap”, so should we still write software applying restrictions from 4 decades ago?