Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

OSGeo ireland keynote 2017 by Markus Neteler


Published on

Keynote held at OSGeo Ireland – 1st National Symposium 2017.

For details, see

Published in: Software
  • You can try to use this service ⇒ ⇐ I have used it several times in college and was absolutely satisfied with the result.
    Are you sure you want to  Yes  No
    Your message goes here
  • Hello! Get Your Professional Job-Winning Resume Here - Check our website!
    Are you sure you want to  Yes  No
    Your message goes here

OSGeo ireland keynote 2017 by Markus Neteler

  1. 1. ©2017MarkusNeteler,CC-BY-SA Keynote OSGeo: Community driven Open Source Geospatial OSGeo Ireland – 1st National Symposium 2017 Markus Neteler mundialis GmbH & Co. KG PostGISomics
  2. 2. ©2017MarkusNeteler,CC-BY-SA About the speaker Markus Neteler: Germany – Italy – Germany ● GRASS GIS user since 1993, coordinator & dev since 1997 ● Cofounder of (1999), (2005), (2006) ● Worked in science from 1999-2015 (mainly in Italy) ● Since 2016: partner and general manager at mundialis, Bonn (DE) ... favorite topics ● massive GIS data processing and Earth Observation ● Open Source GIS guy (especially GRASS GIS development) ● gained HPC experience through processing of MODIS Land Surface Temperature : “EuroLST” – 15 years of gap free daily data at 250m resolution ● disease vector modeling (tiger mosquito etc.)
  3. 3. ©2017MarkusNeteler,CC-BY-SA Quick introduction What is OSGeo ?
  4. 4. ©2017MarkusNeteler,CC-BY-SA It all starts with a map! Img. courtesy: J Westervelt 2006: Early GRASS Community Views on FOSS A printed digital map, roughly in 1982.
  5. 5. ©2017MarkusNeteler,CC-BY-SA Open Source since the 1980s... Open Source is nothing new at all... 1991 – First mailing lists
  6. 6. ©2017MarkusNeteler,CC-BY-SA The 1990's ... ORGANIZATIONS 1992 GRASS Inter-Agency Coordinating Committee → Open GRASS Foundation (OGF) → OpenGIS Consortium (OGC) 1994 – Tim Berners-Lee decided to constitute the World Wide Web Consortium (W3C) 1994 – Open Geospatial Consortium (OGC) founded Open GIS Open Geospatial Consortium (OGC) Consortium (OGC) GRASS Interagency Steering Commitee 1990 1992 2006 Open GRASS Foundation (OGF) 1994 2004 OSGeo
  7. 7. ©2017MarkusNeteler,CC-BY-SA 1980 1985 20001990 1995 2005 2010 WWW Civil Internet MOSS GRASS GIS PROJ4 UMN Mapserver deegree GDAL/OGR OSSIM GEOS PostGIS QGIS Mapbuilder Geonetwork MapGuide OS Openlayers Mapbender gvSIG Open Source GIS Timeline Communities developing software
  8. 8. ©2017MarkusNeteler,CC-BY-SA GRASS GIS FDO … the OSGeo community: at time more than 28,000 unique subscribers in over 240 topic oriented mailing lists, since 2006 metaCRS Open Source GIS brought to you by...
  9. 9. ©2017MarkusNeteler,CC-BY-SA Open Source Geospatial Foundation Mission Foster global adoption of open geospatial technology by being an inclusive software foundation devoted to an open philosophy and participatory community driven development.
  10. 10. ©2017MarkusNeteler,CC-BY-SA OSGeo supports: Software Data Education Community Open Source Geospatial Foundation Initiatives: ICA-OSGeo Labs "Geo For All"
  11. 11. ©2017MarkusNeteler,CC-BY-SA Open Source Geospatial Foundation Goals ● provide resources for foundation projects; ● foster the use of open source geospatial software; ● encourage interoperability with open and community standards; ● ensure interoperability between the foundation projects; ● encourage a high degree of quality and innovation in foundation projects; ● champion the use of open-source and community participation through the development of an open education curriculum ● enable communication and cooperation amongst OSGeo communities; ● champion community building through horizontal (local chapters) engagement and through vertical (sector specific) agreements with like- minded organizations; ● be a welcoming and inclusive worldwide organization at all levels; ● celebrate excellence, openness and service within the OSGeo community.
  12. 12. ©2017MarkusNeteler,CC-BY-SA Education: Geo for All!
  13. 13. ©2017MarkusNeteler,CC-BY-SA The FOSSGIS ecosystem: OSGeo LiveDVD and LiveUSB stick
  14. 14. ©2017MarkusNeteler,CC-BY-SA Support through Professional Service Providers A few logos out of many....
  15. 15. ©2017MarkusNeteler,CC-BY-SA GRASS GIS in a nutshell
  16. 16. ©2017MarkusNeteler,CC-BY-SA Geographic Resources Analysis Support System Open Source GIS, developed since 1984, since 1999 GNU GPL Portable code (many operating systems, 32/64bit) Your GIS backbone – linkable to: GNU/Linux MacOSX MS-Windows (IBM AIX, *BSD, ...) What's GRASS GIS?
  17. 17. ©2017MarkusNeteler,CC-BY-SA A wealth of functionality: GRASS GIS ● Raster 2D/3D (voxel) processing ● Vector 2D/3D topological processing ● Vector network analysis support ● Image processing system ● Space-time cubes, temporal GIS ● Native raster and vector format ● 3D Visualization system ● DBMS integrated (SQL) with SQLite, DBF, PostgreSQL, MySQL, and ODBC drivers From DXF Nagshead LiDAR time series: dune moving over 9 years (NC, USA) – animation
  18. 18. ©2015MarkusNeteler,Italy Elevation model, 1m res. Basins, thresh = 1000 cells (watersheds) (vectorize with Stream network Flow accumulation TCI multiple flow direction Hydrological analysis with GRASS GIS
  19. 19. ©2015MarkusNeteler,Italy VIEW Credit: Helena Mitasova, NCSU Hydrological analysis with GRASS GIS
  20. 20. ©2015MarkusNeteler,Italy CONTAINS with points CROSSES with lines EQUALS CONTAINS with polygon WITHINTOUCHES DISJOINT INTERSECTS OVERLAPS Vector analysis using GEOS backend
  21. 21. ©2015MarkusNeteler,Italy GRASS GIS 7: Space-time functionality g.gui.tplot: plots the values of one or more temporal raster datasets for a queried point defined by a coordinate pair Screenshots: Veronica Andreo (in PDF, click for animation)
  22. 22. ©2017MarkusNeteler,CC-BY-SA GRASS GIS 7 – QGIS integration with PostGIS data storage
  23. 23. ©2015MarkusNeteler,Italy An interactive (Web based!) shortcourse on writing GRASS scripts in Python Python and GRASS GIS 7 (ipython)
  24. 24. ©2015MarkusNeteler,Italy ● Since 2005 (>>10 years) GRASS GIS is running natively on 64bit CPUs ● Large File Support ● Runs on Linux, AIX, Solaris, freeBSD, netBSD, ... ● Installed on Grids and TOP500 supercomputers (AKKA Umeå Sweden, ENEA Frascati Italy, Aurel Slovakia, USA, …) ● Various ways of parallelization Hints: FOSS4G on supercomputers: HPC
  25. 25. ©2017MarkusNeteler,CC-BY-SA GRASS GIS 7.2 REST API Flask, NGINX, Redis EO-me frontend: Web interface SSD storage for GRASS GIS DB: ● Tile database ● GIS database REST GRASS Server Metadata Redis HA Setup REST GRASS Server GRASS REST API Server 1 REST GRASS Server HTTPS Load Balancer Web Mapping Service WMS Server uses GRASS REST API to receive images from GRASS GIS DB Storage REST GRASS Server GRASS REST API Server 2 REST GRASS Server GRASS REST API Server 3 GRASS REST API Server 4 REST GRASS Server GRASS REST API Server 5 Cluster NetworkCluster Network Storage NetworkStorage Network Workers Clients using WMS and GRASS REST API EO-me backend Currently deployed at IPT Poland for ESA Sentinel-2A metadata enhancer (“EO-me”) > 750,000 scenes – 5000 new scenes/day Newly arriving tiles are immediately processed Cloud based computing: GeoServer, GRASS GIS
  26. 26. ©2017MarkusNeteler,CC-BY-SA FOSS4G development in OSGeo
  27. 27. ©2017MarkusNeteler,CC-BY-SA Legal aspects License compliance (e.g., GPL) No code copying from books like “Numerical Receipes in C” Ensure that 3rd party contributions are clean Employers must agree that work time is spent Full transparency and peer review help to minimize the risk. Apache or OSGeo Foundation Incubation phase Graduation Code vetting
  28. 28. ©2015MarkusNeteler,Italy Automated unit tests: Travis-CI and more
  29. 29. ©2017MarkusNeteler,CC-BY-SA Development: Team structure & “Code habitats” ● Two main types of developers are observed: Generalists ←→ Specialist (majority) ● It appears that many developers search for themselves “code habitats”, their area of expertise (e.g. in GRASS GIS a selection of libraries or commands which are maintained over time) – specialists ● these “code habitats” are often stable over years ● only a few experts (super specialists :-) with deep knowledge about code optimization and code portability (ANSI C etc standards) ● A few “garbage collectors” (generalists) fixes lots of odds 'n ends ● knowledge sharing in mailing lists and at OSGeo code sprints
  30. 30. ©2017MarkusNeteler,CC-BY-SA Development: Team structure & “Code habitats” GRASS GIS development visualization from 1999 to 2013 with Gource Developers and their programming activities are animated through small “agents”
  31. 31. ©2017MarkusNeteler,CC-BY-SA 2. Developer detects bug 60% 20% 20% (Percentages are estimated) Other developers New release 3. New features SVN/git code Repository Release cycle 1. User sends bug report Bugtracker Mailing list20% 80% Flow from bug reporting to new releases: Communication matters in development!
  32. 32. ©2017MarkusNeteler,CC-BY-SA The community idea in OSGeo
  33. 33. ©2017MarkusNeteler,CC-BY-SA Vision Empower everyone with open source geospatial Local chapters: ● Bring a more local context to OSGeo ● Provide networking opportunities ● Provide training and support to local community ● Promote OSGeo through events ● Translate documents, websites, software OSGeo Local Chapters
  34. 34. ©2017MarkusNeteler,CC-BY-SA Community Sprint in Como 2015Community Sprint in Como 2015 Development meetings: Community sprints
  35. 35. ©2017MarkusNeteler,CC-BY-SA National and International Conferences! Jo Hempel 2016
  36. 36. Thank you! Contact: Dr. Markus Neteler Email: Web: Credit:Sentinel-2A,22 Nov 2016 Contains modified Copernicus Sentinel data [2015-2016]/ESA/mundialis