• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Overview of OSGeo + OGC + Neo4J Spatial + GeoServer
 

Overview of OSGeo + OGC + Neo4J Spatial + GeoServer

on

  • 806 views

Overview of OSGeo + OGC + Neo4J Spatial + GeoServer

Overview of OSGeo + OGC + Neo4J Spatial + GeoServer

Statistics

Views

Total Views
806
Views on SlideShare
806
Embed Views
0

Actions

Likes
1
Downloads
13
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Overview of OSGeo + OGC + Neo4J Spatial + GeoServer Overview of OSGeo + OGC + Neo4J Spatial + GeoServer Presentation Transcript

    • Graph BigData – Neo4J Spatial Frans Thamura frans@meruvian.com © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential
    • Who is Frans Thamura? • BlueOxygen Marketplace (www.blueoxygen.net)‫ - ‏‬Founder - Open Source Project on Java, since 2001. • JUG Indonesia (http://www.jug.or.id) - Founder • Meruvian Group (http://www.meruvian.org) - Founder • jTechnopreneur (http://www.jtechnopreneur) - Founder • JENI Advisory Board (http://www.jeni.or.id) • Oracle Ace Director • Sun Java Champion • CodeAndroid Indonesia Chapter (www.codeandroid.or.id) • OpenStack Indonesia Chapter (www.openstack-id.org) • OSGeo Indonesia (www.osgeo.or.id) © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed.
    • Meruvian • Meruvian is Development and Services Institute based on Java and Enterprise OpenSource. • Found as a gap solution between education and industry • Meruvian start operates at March 28, 2006 • Founder: Frans Thamura • Knowledge Management Oriented Industry Meruvian Education © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed.
    • JENI 2.0 © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed.
    • Open Source Geospatial Foundation http://www.osgeo.or.id © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed.
    • OSGeo's Mission Support and promote the highest quality Open Source Geospatial Software © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed.
    • OSGeo's Structure Charter Members vote Board of 9 Directors and President Officers Officers 25 Officers represent Committees Committees Committees Committees Committees Committees Local Local Chapters Local Chapters Chapters 147 Charter Members elected by Membership © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed. Local Local Chapters Foundation Chapters Projects Sponsors
    • web mapping Quantum GIS MapServer UMN MapServer Quantum GIS OSSIM GRASS GIS MapNik uDig Geopublisher gvSIG deegree GeoMajas deegree GIS ZOO Project desktop GIS OpenStreetMap GMT MapFish OpenLayers KOSMO MapGuide OS GDAL/OGR FDO GeoKettle GeoServer GeoTools Mapbender GeoNetwork Viking metadata GEOS PostGIS MetaCRS SpatialLite © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed. libraries
    • The Open Geospatial Consortium (OGC) • • • • • The Open Geospatial Consortium (OGC) is an international industry consortium 481 members (as of March 2013), companies, government agencies and universities Operates under a consensus process to develop publicly available interface standards. OGC Standards support interoperable solutions that "geo-enable" the Web, wireless & location-based services and mainstream IT. The standards empower producers to make complex spatial information and services accessible Slide by courtesy of Athina Trakas © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed.
    • GeoServer • GeoSpatial enterprise gateway – Java Enterprise – Management and Dissemination of raster and vector data • Standards compliant – – – – • OGC WCS 1.0, 1.1.1 (RI), 2.0 in the pipeline OGC WFS 1.0, 1.1 (RI), 2.0 OGC WMS 1.1.1, 1.3 OGC WPS 1.0.0 Google Earth/Maps support – KML, GeoSearch, etc.. © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed.
    • GeoServer: Format & Protocols © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed.
    • GeoServer Architecture © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed.
    • NoSQL © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed.
    • Neo4j – Nodes, Relationships, Properties • Nodes have different properties – Matrix characters: People vs. Programs • Build structure as you go – Who loves Neo? © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed.
    • © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed.
    • Neo4j Spatial • Core – – – – • Storage Search Operations (GeoProcessing) I/O (Import / Export) Extensions – Geotools & GeoServer – uDig – OpenStreetMap © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed.
    • Graph Pattern diamond franklin butterfly robertson star horton © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed. bull hall-janko Page 17 17
    • Trends in BigData & NOSQL • Increase data size (bigdata) – “Today we create as much information as we did up to 2003” - Eric Schmidt • Increasingly connected data (graph data) – for example, text documents to html • Semi-structured data – individualization of data, with common sub-set1. increasing data size (big data) – “Every 2 d • Architecture - a facade over multiple services – from monolithic to modular, distributed applications © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed. Page 18 18
    • Graph Everywhere • Relationships in – Politics, Economics, History, Science, Transportation • Biology, Chemistry, Physics, Sociology – Body, Ecosphere, Reaction, Interactions • Internet – Hardware, Software, Interaction • Social Networks – Family, Friends – Work, Communities – Neighbours, Cities, Society Page 19 © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed.
    • Good Relationships • • • • • • • The world is rich, messy and related data Relationships are as least as important as the things they connect Graphs = Whole > Σ parts Complex interactions Always changing, change of structures as well Graph: Relationships are part of the data RDBMS: Relationships part of the fixed schema Page 20 © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed.
    • Page 21 © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed.
    • A graph database... • • NO: not for charts & diagrams, or vector artwork YES: for storing data that is structured as a graph – remember linked lists, trees? – graphs are the general-purpose data structure • • “A relational database may tell you the average age of everyone in this session, but a graph database will tell you who is most likely to buy you a beer.” Page 22 © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed.
    • You know relational now consider relationships... foo foo_bar bar © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed. Page 23 23
    • We're talking about a Property Graph + Indexes (for easy look-ups) Properties (each a key+value) © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed. Page 24 24
    • Looks different, fine. Who cares? • a sample social graph • with ~1,000 persons • average 50 friends per person • pathExists(a,b) limited to depth 4 • caches warmed up to eliminate disk I/O # persons Relational 1,000 database query time 2000ms Neo4j 1,000 2ms Neo4j 1,000,000 2ms Page 25 © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed.
    • Neo4j is a Graph Database • A Graph Database: • • • a schema-free Property Graph perfect for complex, highly connected data A Graph Database: • • • • • reliable with real ACID Transactions scalable: 32 Billion Nodes, 32 Billion Relationships, 64 Billion Properties fast with more than 1M traversals / second Server with REST API, or Embeddable on the JVM higher-performance with High-Availability (read scaling) © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed. Page 26 26
    • Create Graph with Cypher CREATE (steve {name: “Steve Vinoski”}) -[:PRESENTED_WITH {date: {day}}]-> (michael {name: “Michael Hunger”}) © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed.
    • Bindings REST: // © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed. Page 28 28
    • Connecting and Splitting • Routing • OSM Dynamic Layers © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed.
    • Future • Editing – Fine Grained Geotools Feature Editing – OSM Editor • OSM – Caching sub-graphs (desktop & mobile) – More Dynamic Layers & Shapefile export • Topology – Persist all topological results in graph • Benchmarking & Performance – Improved indexing – Composite index © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed.
    • OpenStreetMap © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed.
    • OpenStreetMap © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed.
    • Snappr - OpenStreet /Neo4J https://github.com/peterneubauer/snappstr © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential - Not to be Copied or Distributed.
    • Thank You Frans Thamura frans@meruvian.com https://www.slideshare.net/flatburger/overview-of-osgeo-ogc-neo4j-spatial-geoserver © 2004 – 2009 , Meruvian Foundation. All rights reserved. Proprietary and Confidential