Setting up a GeoServer can sometimes be deceptively simple. However, going from proof of concept to production requires a number of steps to be taken in order to optimize the server in terms of availability, performance and scalability. The presentation will show how to get from a basic set up to a battle ready, rock solid installation by showing the ropes an advanced user already mastered.
GeoServer on Steroids at FOSS4G Europe 2014GeoSolutions
Setting up a GeoServer can sometimes be deceptively simple. However, going from proof of concept to production requires a number of steps to be taken in order to optimize the server in terms of availability, performance and scalability.
The presentation will show how to get from a basic setup to a battle ready, rock solid installation by showing the ropes an advanced user already mastered.
Raster data in GeoServer and GeoTools: Achievements, issues and future devel...GeoSolutions
The purpose of this presentation is, on a side, to dissect the developments performed during last year as far as raster data support in GeoTools and GeoServer is concerned, while on the other side to introduce and discuss the future development directions.
Advancements and improvements for the management of raster mosaic and pyramids will be introduced and analyzed, as well as the latest developments for the exploitation of GDAL raster sources.
Extensive details will be provided on the latest updates for the management of multidimensional raster data used in the Remote Sensing and MetOc fields.
The presentation will also introduce and provide updates on the JAITools and ImageIO-Ext projects. JAITools provides a number of new raster data analysis operators, including powerful and fast raster algebra support. ImageIO-Ext bridges the gap across the Java world and native raster data access libraries providing high performance access to GDAL, Kakadu and other libraries.
The presentation will wrap up providing an overview of unresolved issues and challenges that still need to be addressed, suggesting tips and workarounds allowing to leverage the full potential of the systems.
GeoServer in Production: we do it, here is how!GeoSolutions
The presentation will describe how to setup a production system based on GeoServer from the points of view of performance, availability and security. The suggestions will start covering how a single node GeoServer should be prepared for internet usage, tuning logging, connection pools, security, data and JVM preparation, keeping disk, memory and CPU usage in check within the limits of the available resources. We’ll then move to tools used to monitor the production instances, ranging from probes to request auditing and watch-dogs. Finally the presentation will cover setting up a cluster of server and the strategies for keeping them in synch, from the traditional multi-tier setup (testing vs production) to the systems that need to keep an ever evolving catalog of layers constantly on-line and in synch.
Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...GeoSolutions
The purpose of this presentation is to discuss the developments during last years in raster data support in GeoTools and GeoServer, and also to introduce and discuss future development directions.
Creating Stunning Maps in GeoServer: mastering SLD and CSS stylesGeoSolutions
Various software can style maps and generate a proper SLD document for OGC compliant WMS like GeoServer to use. However, in most occasions, the styling allowed by the graphical tools is pretty limited and not good enough to achieve good looking, readable and efficient cartographic output. For those that like to write their own styles CSS also represents a nice alternatives thanks to its compactness and expressiveness.
Several topics will be covered, providing examples in both SLD and CSS for each, including: mastering multi-scale styling, using GeoServer extensions to build common hatch patterns, line styling beyond the basics, such as cased lines, controlling symbols along a line and the way they repeat, leveraging TTF symbol fonts and SVGs to generate good looking point thematic maps, using the full power of GeoServer label lay-outing tools to build pleasant, informative maps on both point, polygon and line layers, including adding road plates around labels, leverage the labeling subsystem conflict resolution engine to avoid overlaps in stand alone point symbology, blending charts into a map, dynamically transform data during rendering to get more explicative maps without the need to pre-process a large amount of views.
The presentation aims to provide the attendees with enough information to master SLD/CSS documents and most of GeoServer extensions to generate appealing, informative, readable maps that can be quickly rendered on screen.
Advanced Security with GeoServer - FOSS4G 2015GeoSolutions
The presentation will provide an introduction to GeoServer own authentication and authorization subsystems. We’ll cover the supported authentication protocols, such as from basic/digest authentication and CAS support, check through the various identity providers, such as local config files, database tables and LDAP servers, and how it’s possible to combine the various bits in a single comprehensive authentication tool, as well as providing examples of custom authentication plugins for GeoServer, integrating it in a home grown security architecture.
We’ll then move on to authorization, describing the GeoServer pluggable authorization mechanism and comparing it with proxy based solution, and check the built in service and data security system, reviewing its benefits and limitations.
Finally we’ll explore the advanced authentication provider, GeoFence, explore the levels on integration with GeoSErver, from the simple and seamless direct integration to the more sophisticated external setup, and see how it can provide GeoServer with complex authorization rules over data and OGC services, taking into account the current user, OGC request and requested layers to enforce spatial filters and alphanumeric filters, attribute selection as well as cropping raster data to areas of interest.
GeoServer on Steroids at FOSS4G Europe 2014GeoSolutions
Setting up a GeoServer can sometimes be deceptively simple. However, going from proof of concept to production requires a number of steps to be taken in order to optimize the server in terms of availability, performance and scalability.
The presentation will show how to get from a basic setup to a battle ready, rock solid installation by showing the ropes an advanced user already mastered.
Raster data in GeoServer and GeoTools: Achievements, issues and future devel...GeoSolutions
The purpose of this presentation is, on a side, to dissect the developments performed during last year as far as raster data support in GeoTools and GeoServer is concerned, while on the other side to introduce and discuss the future development directions.
Advancements and improvements for the management of raster mosaic and pyramids will be introduced and analyzed, as well as the latest developments for the exploitation of GDAL raster sources.
Extensive details will be provided on the latest updates for the management of multidimensional raster data used in the Remote Sensing and MetOc fields.
The presentation will also introduce and provide updates on the JAITools and ImageIO-Ext projects. JAITools provides a number of new raster data analysis operators, including powerful and fast raster algebra support. ImageIO-Ext bridges the gap across the Java world and native raster data access libraries providing high performance access to GDAL, Kakadu and other libraries.
The presentation will wrap up providing an overview of unresolved issues and challenges that still need to be addressed, suggesting tips and workarounds allowing to leverage the full potential of the systems.
GeoServer in Production: we do it, here is how!GeoSolutions
The presentation will describe how to setup a production system based on GeoServer from the points of view of performance, availability and security. The suggestions will start covering how a single node GeoServer should be prepared for internet usage, tuning logging, connection pools, security, data and JVM preparation, keeping disk, memory and CPU usage in check within the limits of the available resources. We’ll then move to tools used to monitor the production instances, ranging from probes to request auditing and watch-dogs. Finally the presentation will cover setting up a cluster of server and the strategies for keeping them in synch, from the traditional multi-tier setup (testing vs production) to the systems that need to keep an ever evolving catalog of layers constantly on-line and in synch.
Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...GeoSolutions
The purpose of this presentation is to discuss the developments during last years in raster data support in GeoTools and GeoServer, and also to introduce and discuss future development directions.
Creating Stunning Maps in GeoServer: mastering SLD and CSS stylesGeoSolutions
Various software can style maps and generate a proper SLD document for OGC compliant WMS like GeoServer to use. However, in most occasions, the styling allowed by the graphical tools is pretty limited and not good enough to achieve good looking, readable and efficient cartographic output. For those that like to write their own styles CSS also represents a nice alternatives thanks to its compactness and expressiveness.
Several topics will be covered, providing examples in both SLD and CSS for each, including: mastering multi-scale styling, using GeoServer extensions to build common hatch patterns, line styling beyond the basics, such as cased lines, controlling symbols along a line and the way they repeat, leveraging TTF symbol fonts and SVGs to generate good looking point thematic maps, using the full power of GeoServer label lay-outing tools to build pleasant, informative maps on both point, polygon and line layers, including adding road plates around labels, leverage the labeling subsystem conflict resolution engine to avoid overlaps in stand alone point symbology, blending charts into a map, dynamically transform data during rendering to get more explicative maps without the need to pre-process a large amount of views.
The presentation aims to provide the attendees with enough information to master SLD/CSS documents and most of GeoServer extensions to generate appealing, informative, readable maps that can be quickly rendered on screen.
Advanced Security with GeoServer - FOSS4G 2015GeoSolutions
The presentation will provide an introduction to GeoServer own authentication and authorization subsystems. We’ll cover the supported authentication protocols, such as from basic/digest authentication and CAS support, check through the various identity providers, such as local config files, database tables and LDAP servers, and how it’s possible to combine the various bits in a single comprehensive authentication tool, as well as providing examples of custom authentication plugins for GeoServer, integrating it in a home grown security architecture.
We’ll then move on to authorization, describing the GeoServer pluggable authorization mechanism and comparing it with proxy based solution, and check the built in service and data security system, reviewing its benefits and limitations.
Finally we’ll explore the advanced authentication provider, GeoFence, explore the levels on integration with GeoSErver, from the simple and seamless direct integration to the more sophisticated external setup, and see how it can provide GeoServer with complex authorization rules over data and OGC services, taking into account the current user, OGC request and requested layers to enforce spatial filters and alphanumeric filters, attribute selection as well as cropping raster data to areas of interest.
Review this presentation to learn what it means to support a spatial database, and start to see the power of answering spatial questions inside a Postgres database.
Advanced GeoServer Security with GeoFenceGeoSolutions
This presentation will provide an introduction to GeoFence, an open source tool to configure and use complex authorization rules to protect data served by GeoServer OGC services.
Mastering Security with GeoServer and GeoFence - FOSS4G EU 2017GeoSolutions
The presentation will provide an introduction to GeoServer own authentication and authorization subsystems. We’ll cover the supported authentication protocols, such as from basic/digest authentication and CAS support, check through the various identity providers, such as local config files, database tables and LDAP servers, and how it’s possible to combine the various bits in a single comprehensive authentication tool, as well as providing examples of custom authentication plugins for GeoServer, integrating it in a home grown security architecture. We’ll then move on to authorization, describing the GeoServer pluggable authorization mechanism and comparing it with proxy based solution, and check the built in service and data security system, reviewing its benefits and limitations. Finally we’ll explore the advanced authentication provider, GeoFence, explore the levels on integration with GeoServer, from the simple and seamless direct integration to the more sophisticated external setup, and see how it can provide GeoServer with complex authorization rules over data and OGC services, taking into account the current user, OGC request and requested layers to enforce spatial filters and alphanumeric filters, attribute selection as well as cropping raster data to areas of interest.
GeoServer an introduction for beginnersGeoSolutions
This presentation will provide an introduction to the GeoServer project and its abilities to publish data with a mix of well-known OGC protocols and other popular protocols and data formats.
Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...GeoSolutions
This presentation will provide the attendee with an introduction to data processing in GeoServer by means of WPS, rendering transformations and SQL views, describing real applications and how these facilities were used in them.
We'll start with the basic WPS capabilities, showing how to build processing request based on existing processes and how to build new processes leveraging scripting languages, and introducing unique GeoServer integration features, showing how processing can seamlessly integrate directly in the GeoServer data sources and complement existing services.
We'll also discuss how to integrate on the fly processing in WMS requests, achieving high performance data displays without having to pre-process the data in advance, and allowing the caller to interactively choose processing parameters.
While the above shows how to make GeoServer perform the work, the processing abilities of spatial databases should not be forgotten, so we’ll show how certain classes of processing can be achieved directly in the database.
At the end the attendee will be able to easily issue WPS requests both for Vectors and Rasters to GeoServer through the WPS Demo Builder, enrich SLDs with on-the-fly rendering transformations and play with SQL views in order to create dynamic layers.
Serving earth observation data with GeoServer: addressing real world requirem...GeoSolutions
The presentation will cover GeoSolutions experience in setting up GeoServer based production systems providing access to earth observation products, with indications of technical challenges, solutions, and deployment suggestion. The presentations will cover topics such as setting up a single unified mosaic from all the available data sources, tailoring access to it to different users, determining the most appropriate stacking order, dealing with multiresolution, different coordinate systems, multiband data, SAR integration, searching for the most appropriate products using a mix of WFS, CSW and so on, serving imagery with high performance WMS and WMTS, performing small and large data extractions with WCS and WPS, closing up with deployment examples and suggestions.
Enterprise class deployment for GeoServer and GeoWebcache Optimizing perform...GeoSolutions
Setting up a GeoServer can sometimes be deceptively simple. However, going from proof of concept to production requires a number of steps to be taken in order to optimize the server in terms of availability, performance and scalability. This presentation will show how to get from a basic set up to a battle ready, rock solid installation by showing the ropes an advanced user already mastered.
The presentation will provide an introduction to GeoServer own authentication and authorization subsystems. We’ll cover the supported authentication protocols, such as from basic/digest authentication and CAS support, check through the various identity providers, such as local config files, database tables and LDAP servers, and how it’s possible to combine the various bits in a single comprehensive authentication tool, as well as providing examples of custom authentication plugins for GeoServer, integrating it in a home grown security architecture.
We’ll then move on to authorization, describing the GeoServer pluggable authorization mechanism and comparing it with proxy based solution, and check the built in service and data security system, reviewing its benefits and limitations.
Finally we’ll explore an advanced authentication tool called GeoFence, and see how it can plug into GeoServer to provide graphical configuration abilities for use complex authorization rules over data and OGC services, taking into account spatial filters, attribute filters, attribute hiding as well as cropping raster data to areas of interest. Finally we’ll show how using LDAP both GeoFence and GeoServer can use a common users database, simplifying administrators job, and provide some real world examples.
This presentation will dive into a development team’s use case for choosing MongoDB as their spatially enabled NoSQL solution. The talk will also cover how the integration of GeoServer can expand the accessibility of your data. GeoServer is the open source implementation of Open Geospatial Consortium (OGC) standards and a core component of the Geospatial Web.
Hudi: Large-Scale, Near Real-Time Pipelines at Uber with Nishith Agarwal and ...Databricks
Uber has real needs to provide faster, fresher data to data consumers & products, running hundreds of thousands of analytical queries everyday. Uber engineers will share the design, architecture & use-cases of the second generation of ‘Hudi’, a self contained Apache Spark library to build large scale analytical datasets designed to serve such needs and beyond. Hudi (formerly Hoodie) is created to effectively manage petabytes of analytical data on distributed storage, while supporting fast ingestion & queries. In this talk, we will discuss how we leveraged Spark as a general purpose distributed execution engine to build Hudi, detailing tradeoffs & operational experience. We will also show to ingest data into Hudi using Spark Datasource/Streaming APIs and build Notebooks/Dashboards on top using Spark SQL.
GeoServer is the start of a great open source success story. This talk introduces the core GeoServer application and explores the ecosystem that has developed around this beloved OSGeo application.
This talks draws on the GeoServer ecosystem for use-cases and examples of how the application has been used successfully by a wide range of organizations.
Andrea Amie from GeoSolutions is on hand to share success stories highlighting GeoServer use in managing vulnerable ecosystems, agriculture information management, and marine data management.
Jody Garnett will look at how GeoServer enables Boundless products including Boundless Server and Boundless Server Enterprise.
We will look at GeoServer use at OSGeo with both GeoNetwork and GeoNode making use of the technology.
LocationTech is not ignored with the “big data” players in the form of GeoMesa and GeoWave bridging to cloud data sources of epic proportion
We use each use-case to highlights a capability of GeoServer providing an overview of the application drawn from practical examples.
Attend this talk for inspiration on what is possible with GeoServer and open source.
Using GeoServer for spatio-temporal data management with examples for MetOc a...GeoSolutions
This presentation will provide detailed information on how to ingest and configure spatio-temporal data in GeoServer, to be served using OGC services, with examples from WMS and WCS services.
GeoSolutions has been involved into a number of projects, ranging from local administrations to global institutions, involving GeoNode deployments, customizations and enhancements. A gallery of projects and use cases will showcase the versatility and effectiveness of GeoNode, both as a standalone application and as a service component, for building secured geodata catalogs and web mapping services. Lastly, ongoing and future developments will be presented ranging from the upcoming integration with MapStore to the monitoring and analytics dashboard or the support for time series data.
The following presentation was held by GeoSolutions founder and managing director Simone Giannecchini at GeoSpatial World Forum INSPIRE Conference in Lisbon, 2015.
The workshop will provide a hands on introduction to the basic GeoServer concepts, as well as usage and configuration, with particular attention to the setup of INSPIRE compliant view services with a demonstration set of data in various formats, both raster and vector.
Setting up a GeoServer can sometimes be deceptively simple. However, going from proof-of-concept to production requires a number of steps to be taken in order to optimize the server in terms of availability, performance and scalability. The presentation will show how to get from a basic setup to a battle-ready, rock-solid installation.
Review this presentation to learn what it means to support a spatial database, and start to see the power of answering spatial questions inside a Postgres database.
Advanced GeoServer Security with GeoFenceGeoSolutions
This presentation will provide an introduction to GeoFence, an open source tool to configure and use complex authorization rules to protect data served by GeoServer OGC services.
Mastering Security with GeoServer and GeoFence - FOSS4G EU 2017GeoSolutions
The presentation will provide an introduction to GeoServer own authentication and authorization subsystems. We’ll cover the supported authentication protocols, such as from basic/digest authentication and CAS support, check through the various identity providers, such as local config files, database tables and LDAP servers, and how it’s possible to combine the various bits in a single comprehensive authentication tool, as well as providing examples of custom authentication plugins for GeoServer, integrating it in a home grown security architecture. We’ll then move on to authorization, describing the GeoServer pluggable authorization mechanism and comparing it with proxy based solution, and check the built in service and data security system, reviewing its benefits and limitations. Finally we’ll explore the advanced authentication provider, GeoFence, explore the levels on integration with GeoServer, from the simple and seamless direct integration to the more sophisticated external setup, and see how it can provide GeoServer with complex authorization rules over data and OGC services, taking into account the current user, OGC request and requested layers to enforce spatial filters and alphanumeric filters, attribute selection as well as cropping raster data to areas of interest.
GeoServer an introduction for beginnersGeoSolutions
This presentation will provide an introduction to the GeoServer project and its abilities to publish data with a mix of well-known OGC protocols and other popular protocols and data formats.
Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...GeoSolutions
This presentation will provide the attendee with an introduction to data processing in GeoServer by means of WPS, rendering transformations and SQL views, describing real applications and how these facilities were used in them.
We'll start with the basic WPS capabilities, showing how to build processing request based on existing processes and how to build new processes leveraging scripting languages, and introducing unique GeoServer integration features, showing how processing can seamlessly integrate directly in the GeoServer data sources and complement existing services.
We'll also discuss how to integrate on the fly processing in WMS requests, achieving high performance data displays without having to pre-process the data in advance, and allowing the caller to interactively choose processing parameters.
While the above shows how to make GeoServer perform the work, the processing abilities of spatial databases should not be forgotten, so we’ll show how certain classes of processing can be achieved directly in the database.
At the end the attendee will be able to easily issue WPS requests both for Vectors and Rasters to GeoServer through the WPS Demo Builder, enrich SLDs with on-the-fly rendering transformations and play with SQL views in order to create dynamic layers.
Serving earth observation data with GeoServer: addressing real world requirem...GeoSolutions
The presentation will cover GeoSolutions experience in setting up GeoServer based production systems providing access to earth observation products, with indications of technical challenges, solutions, and deployment suggestion. The presentations will cover topics such as setting up a single unified mosaic from all the available data sources, tailoring access to it to different users, determining the most appropriate stacking order, dealing with multiresolution, different coordinate systems, multiband data, SAR integration, searching for the most appropriate products using a mix of WFS, CSW and so on, serving imagery with high performance WMS and WMTS, performing small and large data extractions with WCS and WPS, closing up with deployment examples and suggestions.
Enterprise class deployment for GeoServer and GeoWebcache Optimizing perform...GeoSolutions
Setting up a GeoServer can sometimes be deceptively simple. However, going from proof of concept to production requires a number of steps to be taken in order to optimize the server in terms of availability, performance and scalability. This presentation will show how to get from a basic set up to a battle ready, rock solid installation by showing the ropes an advanced user already mastered.
The presentation will provide an introduction to GeoServer own authentication and authorization subsystems. We’ll cover the supported authentication protocols, such as from basic/digest authentication and CAS support, check through the various identity providers, such as local config files, database tables and LDAP servers, and how it’s possible to combine the various bits in a single comprehensive authentication tool, as well as providing examples of custom authentication plugins for GeoServer, integrating it in a home grown security architecture.
We’ll then move on to authorization, describing the GeoServer pluggable authorization mechanism and comparing it with proxy based solution, and check the built in service and data security system, reviewing its benefits and limitations.
Finally we’ll explore an advanced authentication tool called GeoFence, and see how it can plug into GeoServer to provide graphical configuration abilities for use complex authorization rules over data and OGC services, taking into account spatial filters, attribute filters, attribute hiding as well as cropping raster data to areas of interest. Finally we’ll show how using LDAP both GeoFence and GeoServer can use a common users database, simplifying administrators job, and provide some real world examples.
This presentation will dive into a development team’s use case for choosing MongoDB as their spatially enabled NoSQL solution. The talk will also cover how the integration of GeoServer can expand the accessibility of your data. GeoServer is the open source implementation of Open Geospatial Consortium (OGC) standards and a core component of the Geospatial Web.
Hudi: Large-Scale, Near Real-Time Pipelines at Uber with Nishith Agarwal and ...Databricks
Uber has real needs to provide faster, fresher data to data consumers & products, running hundreds of thousands of analytical queries everyday. Uber engineers will share the design, architecture & use-cases of the second generation of ‘Hudi’, a self contained Apache Spark library to build large scale analytical datasets designed to serve such needs and beyond. Hudi (formerly Hoodie) is created to effectively manage petabytes of analytical data on distributed storage, while supporting fast ingestion & queries. In this talk, we will discuss how we leveraged Spark as a general purpose distributed execution engine to build Hudi, detailing tradeoffs & operational experience. We will also show to ingest data into Hudi using Spark Datasource/Streaming APIs and build Notebooks/Dashboards on top using Spark SQL.
GeoServer is the start of a great open source success story. This talk introduces the core GeoServer application and explores the ecosystem that has developed around this beloved OSGeo application.
This talks draws on the GeoServer ecosystem for use-cases and examples of how the application has been used successfully by a wide range of organizations.
Andrea Amie from GeoSolutions is on hand to share success stories highlighting GeoServer use in managing vulnerable ecosystems, agriculture information management, and marine data management.
Jody Garnett will look at how GeoServer enables Boundless products including Boundless Server and Boundless Server Enterprise.
We will look at GeoServer use at OSGeo with both GeoNetwork and GeoNode making use of the technology.
LocationTech is not ignored with the “big data” players in the form of GeoMesa and GeoWave bridging to cloud data sources of epic proportion
We use each use-case to highlights a capability of GeoServer providing an overview of the application drawn from practical examples.
Attend this talk for inspiration on what is possible with GeoServer and open source.
Using GeoServer for spatio-temporal data management with examples for MetOc a...GeoSolutions
This presentation will provide detailed information on how to ingest and configure spatio-temporal data in GeoServer, to be served using OGC services, with examples from WMS and WCS services.
GeoSolutions has been involved into a number of projects, ranging from local administrations to global institutions, involving GeoNode deployments, customizations and enhancements. A gallery of projects and use cases will showcase the versatility and effectiveness of GeoNode, both as a standalone application and as a service component, for building secured geodata catalogs and web mapping services. Lastly, ongoing and future developments will be presented ranging from the upcoming integration with MapStore to the monitoring and analytics dashboard or the support for time series data.
The following presentation was held by GeoSolutions founder and managing director Simone Giannecchini at GeoSpatial World Forum INSPIRE Conference in Lisbon, 2015.
The workshop will provide a hands on introduction to the basic GeoServer concepts, as well as usage and configuration, with particular attention to the setup of INSPIRE compliant view services with a demonstration set of data in various formats, both raster and vector.
Setting up a GeoServer can sometimes be deceptively simple. However, going from proof-of-concept to production requires a number of steps to be taken in order to optimize the server in terms of availability, performance and scalability. The presentation will show how to get from a basic setup to a battle-ready, rock-solid installation.
Advanced Cartographic Map Rendering in GeoServerGeoSolutions
Various software can style maps and generate a proper SLD document for OGC compliant WMS like GeoServer to use. However, in most occasions, the styling allowed by the graphical tools is pretty limited and not good enough to achieve good looking, readable and efficient cartographic output. For those that like to write their own styles CSS also represents a nice alternatives thanks to its compact-ness and expressiveness.
Several topics will be covered, providing examples in both SLD and CSS for each, including: mastering multi-scale styling, using GeoServer extensions to build common hatch patterns, line styling beyond the basics, such as cased lines, controlling symbols along a line and the way they repeat, leveraging TTF symbol fonts and SVGs to generate good looking point thematic maps, using the full power of GeoServer label lay-outing tools to build pleasant, informative maps on both point, polygon and line layers, including adding road plates around labels, leverage the labelling subsystem conflict resolution engine to avoid overlaps in stand alone point symbology, blending charts into a map, dynamically transform data during rendering to get more explicative maps without the need to pre-process a large amount of views. The presentation aims to provide the attendees with enough information to master SLD/CSS documents and most of GeoServer extensions to generate appealing, informative, readable maps that can be quickly rendered on screen.
Mapping the world beyond web mercator - FOSS4G 2015GeoSolutions
Most popular mapping presentations today, ranging from clients to servers, show and discuss only maps in EPSG:3857, the popular Mercator derived projection used by OSM as well as
most commercial tiles providers.
There is however an interesting, exciting world of map projections out there, that are still being used in a variety of context. This presentation will introduce the advancement made in GeoTools and GeoServer to handle those use cases, where users have a worldwide data set, and need to view all or part of it in multiple projections, some of which valid in a limited area, and requiring the software to perform a proper display of it on the fly, without any preparation.
We’ll discuss GeoTools/GeoServer “advanced projection handling” manages to deal with these cases, wrapping data, dealing with the poles and the dateline, cutting on the fly excess data, densifying on the fly long lines as needed to ensure a smooth reprojection, for a variety of cases, ranging from seemingly innocuous datum shifts, maps having the prime meridian over the pacific, and the various tricks to properly handle stereographic, transverse mercator, Lambert conic and other limited area projections against world wide source data sets.
Raster Data In GeoServer and GeoTools: Achievements, Issues And Future Develo...GeoSolutions
The purpose of this presentation is, on a side, to dissect the developments performed during last year as far as raster data support in GeoTools and GeoServer is concerned, while on the other side to introduce and discuss the future development directions.
Advancements and improvements for the management of multidimensional raster data (NetCDF, GRIB, HDF) and mosaic thereof will be introduced, as well as the available ways to manage sliding windows of data via the REST API and importer.
Extensive details will be provided on the latest updates for the management of multidimensional raster data used in the Remote Sensing and MetOc fields, including support for WCS EO and WMS EO, and some considerations on the WCS MetOc extensions.
The presentation will also introduce and provide updates on jai-ext, imageio-ext, and JAITools. jai-ext provides extended JAI operators that correctly handle NODATA and regione of interests (masks), JAITools provides a number of new raster data analysis operators, including powerful and fast raster algebra support, while ImageIO-Ext bridges the gap across the Java world and native raster data access libraries providing high performance access to GDAL, Kakadu and other libraries.
The presentation will wrap up providing an overview of unresolved issues and challenges that still need to be addressed, suggesting tips and workarounds allowing to leverage the full potential of the systems.
What can you do with this GeoServer thing? This talk covers some of the basic (and not so basic) ways to use GeoServer to publish your geospatial data and make it look great!
GeoServer made its first release in 2001 and has grown into an amazing, capable and diverse program. This also means the “feature list” is spread over years of release announcements, presentations, mailing list archives!
This presentations provides a whirlwind tour of GeoServer and everything it can do today!
This talk is a visual guide to the features of GeoServer. Are you just getting started with GeoServer, or considering it for the first time? Attend this talk and prioritize what you want to look into first. Are you an expert user who has been running GeoServer since Java 1.4? Attend this talk and see what tricks an optimisations you have been missing out on!
SIG Libre 2013 Girona. Cuso Online de SIG y CooperaciónFrancisco Puga
Presentación del curso online de SIG y Cooperación para el congreso de SIG Libre de Girona 2013 en el que participaron Ingeniería Sin Fronteras, iCarto, Laborate y Cartolab
State of GeoServer provides an update on our community and reviews the new and noteworthy features for the Project. The community keeps an aggressive six month release cycle with GeoServer 2.8 and 2.9 being released this year.
Each releases bring together exciting new features. This year a lot of work has been done on the user interface, clustering, security and compatibility with the latest Java platform. We will also take a look at community research into vector tiles, multi-resolution raster support and more.
Attend this talk for a cheerful update on what is happening with this popular OSGeo project. Whether you are an expert user, a developer, or simply curious what these projects can do for you, this talk is for you.
Spatio-temporal Data Handling With GeoServer for MetOc And Remote SensingGeoSolutions
This presentation will provide detailed information on how to handle SpatioTemporal metadata in GeoServer for serving with OGC Services, with a particular focus on WMS and WCS.
MapStore 2, modern mashups with OL3, Leaflet and ReactGeoSolutions
MapStore 2 is an overhaul of the existing MapStore with the goal of creating a webmapping framework which is more lightweight but still modular and easy to work with. It can leverage both OpenLayers 3 or Leaflet as the mapping engine and uses ReactJS and Redux as the core JavaScript libraries. Moreover a 3D viewer based on CesiumJS is available.
MapStore 2 is both a framework and a standalone application. You can use it as a framework to develop your custom WebGis application composing MapStore ReactJS components and components from other libraries (like React Bootstrap), choosing the best mapping library for your purposes. You can also use the MapStore2 application directly, to create, save, and share in a simple and intuitive way maps and mashups created by selecting content from the server such as Google Maps, OpenStreetMap or WMS and WMTS.
The MapStore 2 application consists of two main components MapManager and GeoStore, respectively front-end and back-end. MapManager allows through a unique interface to create, modify, delete and search on maps definition as well as generate a univoque link to embed a map in an external website, share your own maps with the others. GeoStore implements a flexible Java Enterprise infrastructure to manage and search maps with proper management of authentication and authorization.
The presentation will give the audience an extensive overview of the MapStore 2 functionalities for the creation of mapping portals. Eventually, a range of GeoSolutions case studies of MapStore 2 will be presented.
WMS Benchmarking presentation and results, from the FOSS4G 2010 event in Barcelona. 8 different development teams participated in this exercise, to display common data through the WMS standard the fastest. http://2010.foss4g.org/wms_benchmarking.php
GeoServer for Spatio-temporal Data Handling With Examples For MetOc And Remot...GeoSolutions
This presentation will provide detailed information on how to ingest and configure SpatioTemporal in GeoServer to be served using OGC services, with examples from WMS and WCS services.
Topics covered are as follows:
- Discussion over existing data formats and how to preprocess them for best serving with GeoServer
- Configuring SpatioTemporal raster and vector data in GeoServer
- Serving SpatioTemporal raster and vector data with OGC Services
- Tips and techniques to optimize performance and allow maximum exploitation of the available data
The attendees will be provided with the basic knowledge needed to preprocess and ingest the most common spatiotemporal data from the MetOc and Remote Sensing field for serving via GeoServer.
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software
Once in a while, there really is something new under the sun. The rise of cloud-hosted data has fueled innovation in spatial data storage, enabling a brand new serverless architectural approach to spatial data sharing. Join us in our upcoming webinar to learn all about these new ways to organize your data, and leverage data shared by others. Explore the potential of Cloud Native Geospatial Formats in your workflows with FME, as we introduce five new formats: COGs, COPC, FlatGeoBuf, GeoParquet, STAC and ZARR.
Learn from industry experts Michelle Roby from Radiant Earth and Chris Holmes from Planet about these cloud-native geospatial data formats and how they can make data easier to manage, share, and analyze. To get us started, they’ll explain the goals of the Cloud-Native Geospatial Foundation and provide overviews of cloud-native technologies including the Cloud-Optimized GeoTIFF (COG), SpatioTemporal Asset Catalogs (STAC), and GeoParquet.
Following this, our seasoned FME team will guide you through practical demonstrations, showcasing how to leverage each format to its fullest potential. Learn strategic approaches for seamless integration and transition, along with valuable tips to enhance performance using these formats in FME.
Discover how these formats are reshaping geospatial data handling and how you can seamlessly integrate them into your FME workflows and harness the explosion of cloud-hosted data.
Neo4j Spatial - Backing a GIS with a true graph databaseCraig Taverner
Geographic data is naturally structured like a graph, and topological analyses view GIS data as graphs, but until now no-one has tried to make use of a real graph database as the backing store for a GIS. The developers of Neo4j have added features to the popular open source graph database to provide for support for spatial indexing, storage and topology. In addition to these core components, there are a number of useful utilities for importing and exporting data from other popular data sources, and enabling the use of this database in well known libraries and applications in the open source GIS environment.
We will discuss the advantages of using a graph database for geographic data, the performance and scalability implications, and the opportunities enabled by this approach. In today's highly connected social web, there is an increasing need for graph-based data management. At the same time applications are becoming more and more location aware. The time is right for the first geographic graph database.
GeoServer, an introduction for beginnersGeoSolutions
This presentation will provide an introduction to the GeoServer project and its abilities to publish data with a mix of well known OGC protocols and other pupolar protocol and data formats, including:
* Setting up vector and raster data from the GeoServer administration control
* Publishing data via WMS, WFS and WCS
* Styling layers using desktop tools, with a carousel of GeoServer mapping abilities
* Tile caching with WMTS
* Moving to data processing with WPS
* Brief introduction to security
Using Big Data techniques to query and store OpenStreetMap data. Stephen Knox...huguk
This talk will describe his research into using Hadoop to query and manage big geographic datasets, specifically OpenStreetMap(OSM). OSM is an “open-source” map of the world, growing at a large rate, currently around 5TB of data. The talk will introduce OSM, detail some aspects of the research, but also discuss his experiences with using the SpatialHadoop stack on Azure and Google Cloud.
State of GeoServer provides an update on our community and reviews the new and noteworthy features for the Project. The community keeps an aggressive six month release cycle with GeoServer 2.8 and 2.9 being released this year.
Each releases bring together exciting new features. This year a lot of work has been done on the user interface, clustering, security and compatibility with the latest Java platform. We will also take a look at community research into vector tiles, multi-resolution raster support and more.
Attend this talk for a cheerful update on what is happening with this popular OSGeo project. Whether you are an expert user, a developer, or simply curious what these projects can do for you, this talk is for you.
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software
Once in a while, there really is something new under the sun. The rise of cloud-hosted data has fueled innovation in spatial data storage, enabling a brand new serverless architectural approach to spatial data sharing. Join us in our upcoming webinar to learn all about these new ways to organize your data, and leverage data shared by others. Explore the potential of Cloud Native Geospatial Formats in your workflows with FME, as we introduce five new formats: COGs, COPC, FlatGeoBuf, GeoParquet, STAC and ZARR.
Learn from industry experts Michelle Roby from Radiant Earth and Chris Holmes from Planet about these cloud-native geospatial data formats and how they can make data easier to manage, share, and analyze. To get us started, they’ll explain the goals of the Cloud-Native Geospatial Foundation and provide overviews of cloud-native technologies including the Cloud-Optimized GeoTIFF (COG), SpatioTemporal Asset Catalogs (STAC), and GeoParquet.
Following this, our seasoned FME team will guide you through practical demonstrations, showcasing how to leverage each format to its fullest potential. Learn strategic approaches for seamless integration and transition, along with valuable tips to enhance performance using these formats in FME.
Discover how these formats are reshaping geospatial data handling and how you can seamlessly integrate them into your FME workflows and harness the explosion of cloud-hosted data.
This presentation introduces open source, open source GIS, OSGeo. This talk was given to the people who attended 'Capacity Building For National Surveying and Geographic Information Institute' program.
代表的なオープンソース空間データサーバの1つであるGeoServerは、多くの強力な機能を提供します。 特に、さまざまなデータソースからの空間データへの接続とパブリッシングをサポートします。 GeoServerはOpen Geospatial Consortiumによって地理空間フィーチャデータを要求するために設定された標準プロトコルであるWeb Feature Service(WFS)もサポートしています。 しかしながら、GeoServerは2次元ジオメトリのための関数しか提供しないため、3D空間データを処理する関数はほとんどありません。 GeoServerの重要なコンポーネントであるJTS Topology Suiteは3D空間操作をサポートしていないため、ソリッドジオメトリもサポートしていません。 この講演では、3D空間データを扱うために私たちが実装したGeoServerの拡張モジュールを紹介します。
GeoServer, one of the representative open source spatial data servers, provides many powerful features. In particular, it supports connecting to and publishing spatial data from a variety of data sources. GeoServer also supports Web Feature Service (WFS), which is a standard protocol established by the Open Geospatial Consortium to request geospatial feature data. However, GeoServer provides functions only for two-dimensional geometry, so it provides few functions for handling 3D spatial data. Because JTS Topology Suite, which is an important component of GeoServer, does not support 3D spatial operations, it also does not support solid geometries. In this talk, I will introduce extension modules of GeoServer that we have implemented to handle 3D spatial data.
13 - Panorama Necto 14 building models - visualization & data discovery solu...Panorama Software
PANORAMA NECTO 14 TRAINING - Panorama is leading a Business Intelligence 3.0 revolution and a creation of a new generation of Business Intelligence & Data Discovery solutions that enable organizations to leverage the power of Social Decision Making and Automated Intelligence to gain insights more quickly, more efficiently, and with greater relevancy.
www.panorama.com
MapStore 2 is an Open Source webmapping framework which uses ReactJS, Redux, OpenLayers, Leaflet and Cesium.
It supports various OGC Protocols like CSW, WMS, WFS and WMTS and allows end users to create charts and dashboards thanks to its integration with GeoServer.
This presentation has been prepared with the objective to give readers a quick introduction to the Open Source GeoNode platform and its functionalities for the creation of a Spatial Data Infrastructure completely based on open Source components.
Serving earth observation data with GeoServer: addressing real world requirem...GeoSolutions
Information on the latest developments in GeoServer for the support for Earth Observation data with support for the various OGC services and OpenSearch.
This presentation goes over the most important features of GeoServer in order to give the reader an intro about what is good and what is super-good about GeoServer!
The current version reflects the presentation given at FOSS4G 2017 in Boston.
State of GeoServer provides an update on our community and reviews the new and noteworthy features for the Project. The community keeps an aggressive six month release cycle with GeoServer 2.11 and 2.12 being released this year. Each releases bring together exciting new features. This year a lot of work has been done on startup times, large catalogs, REST configuration upgrades, styling languages, styling interface, security,just to name a few. We will also take a look at community research into satellite imagery search and delivery, multi-resolution raster support and more. Attend this talk for a cheerful update on what is happening with this popular OSGeo project. Whether you are an expert user, a developer, or simply curious what these projects can do for you, this talk is for you.
The following presentation "Building Interoperable SDIs with Open Source Products" was held by GeoSolutions' founder and managing director at GeoSpatial World Forum 2015, Lisbon.
Main topics:
- GeoSolutions' presentation
- GeoSolutions' expertise
- GeoSolutions' products (GeoServer, GeoNetwork, MapStore)
- GeoSolutions' main clients
Presentation about GeoServer helded by GeoSolutions technical lead Mauro Bartolomeoli at GeoBusiness 2015, London.
Main topics:
-Quick intro to GeoServer
-What’s new in the 2.6.x and 2.7.x series
-What’s cooking for the future
Introduzione a GeoServer ed ai servizi OGCGeoSolutions
Slide di Introduzione al GeoServer con particolare enfasi sui protocolli OGC da esso supportati.
La presentazione ripercorre con buon livello di dettaglio le funzionalità offerte da GeoServer proponendo dove necessario una breve introduzione ai servizi OGC da esso implementati in modo da rendere l'utente autonomo per quanto riguarda la comprensione dei concetti alla base delle funzionalità di GeoServer stesso.
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
To Graph or Not to Graph Knowledge Graph Architectures and LLMs
GeoServer on Steroids
1. GeoServer on steroids
All you wanted to know
about how to make GeoServer faster
but you never asked
(or you did and no one answered)
Ing. Andrea Aime
Ing. Simone Giannecchini
GeoSolutions
2. GeoSolutions
Founded in Italy in late 2006
Expertise
• Image Processing, GeoSpatial Data Fusion
• Java, Java Enterprise, C++, Python
• JPEG2000, JPIP, Advanced 2D visualization
Supporting/Developing FOSS4G projects
GeoServer, MapStore
GeoNetwork, GeoNode, Ckan
Clients
Public Agencies
Private Companies
http://www.geo-solutions.it
FOSS4G 2015, Seoul
14th-19th September 2015
3. Contents
Preparing raster data
Preparing vector data
Optimizing styling
Output tuning
Tiling and caching
Resource control
Deploy configurations
FOSS4G 2015, Seoul
14th-19th September 2015
5. Raster data checklist
FOSS4G 2015, Seoul
14th-19th September 2015
Objectives
Fast extraction of a subset of the data
Fast extraction of the desired resolution
Check-list
Avoid having to open a large number of files per
request
Avoid parsing of complex structures and slow
compressions
Get to know your bottlenecks
CPU vs Disk Access Time vs Memory
Experiment with
Format, compression, different color models, tile
size, overviews, GeoServer configuration
6. Problematic input formats
FOSS4G 2015, Seoul
14th-19th September 2015
PNG/JPEG direct serving
Bad formats (especially in Java)
No tiling (or rarely supported)
Chew a lot of memory and CPU for
decompression
Mitigate with external overviews
Any input ASCII format (GML grid, ASCII grid)
JPEG2000
Extensible and rich, not (always) fast, can be
difficult to tune for performance (might require
specific encoding options)
MrSID (can work, needs tuning)
ECW (licensing issues)
7. GeoTIFF for the win
FOSS4G 2015, Seoul
14th-19th September 2015
To remember: GeoTiff is a swiss knife
But you don’t want to cut a tree with it!
Tremendously flexible, good for for most (not all)
use cases
BigTiff pushes the GeoTiff limits farther
Use GeoTiff when
Overviews and Tiling stay within 4GB
No additional dimensions
Consider BigTiff for very large file (> 4 GB)
Support for tiling
Support for Overviews
Can be inefficient with very large files + small
tiling
8. GeoTIFF preparation
FOSS4G 2015, Seoul
14th-19th September 2015
(Optional) Use gdal_warp to transform the data in
the most used output reference system (mind, any
reprojection ruins the data a bit)
Use gdal_translate to add inner tiling and fix
eventual issues with coordinate reference system
Add compression options if you disks are
small/slow/not local (consider JPEG compression with
YCBCR color interpretation for photos, LZW/Deflate
for scientific data)
Use gdaladdo to add internal overviews (remember
to replicate compression here)
9. Possible structures
FOSS4G 2015, Seoul
14th-19th September 2015
Single GeoTiff
with internal tiling
and overviews
(GeoTiff < 2GB,
BigTiff < 20-50GB)
Mosaic of GeoTiff, each one
with internal tiling and overviews
(< 500GB, not too many files)
Pyramid
1
2
3
10. Choosing formats and layouts
FOSS4G 2015, Seoul
14th-19th September 2015
Use ImageMosaic when:
A single file gets too big (inefficient seeks, too much
metadata to read, etc..)
Multiple Dimensions (time, elevation, others..)
Avoid mosaics made of many very small files
Single granules can be large
Use Tiling + Overviews + Compression on granules
Use ImagePyramid when:
Tremendously large dataset
Too many files / too large files
Need to serve at all scales
Especially low resolution
For single granules (< 2Gb) GeoTiff is generally a
good fit
11. Proper mosaic preparation
FOSS4G 2015, Seoul
14th-19th September 2015
Optimize files as if you were serving them individually
Keep a balance between number and dimensions of
granules
If memory is scarce:
USE_JAI_IMAGREAD to true
USE_MULTITHREADING to false*
Otherwise
USE_JAI_IMAGREAD to false
ALLOW_MULTITHREADING
to true (Load data from
different granules in parallel)
12. Multidimensional mosaics
FOSS4G 2015, Seoul
14th-19th September 2015
Use Cases:
MetOc data (support for time, elevation)
Data with additional indipendent dimensions
Suggestions
Use ImageMosaic
Use a DBMS for indexing granules (not shapefile)
Add indexes on the dimension columns
Use File Name based property collectors to turn properties
into DB rows attributes
Filter by time, elevation and other attributes via OGC and
CQL filters
Check detailed deck for details!
14. Proper pyramid preparation
FOSS4G 2015, Seoul
14th-19th September 2015
If needed, use gdalbuildvrt to create a
virtual single source for gdal_retile
Use gdal_retile for creating the pyramid
Prepare the list of tiles to be retiled
Create the pyramid with GDAL retile (grab a coffee!)
Chunks should not be too small (here 2048x2048), if you go larger,
use also inner tiling
If the input dataset is huge use the useDirForEachRow option
Too many files in a dir is bad practice
Make sure the number of level is consistent with usage
Too few bad performance at high scale
16. Vector data checklist
FOSS4G 2015, Seoul
14th-19th September 2015
What do we want from vector data:
Binary data
No complex parsing of data structures
Fast extraction of a geographic subset
Fast filtering on the most commonly used
attributes
17. Choosing a format
FOSS4G 2015, Seoul
14th-19th September 2015
Slow formats
WFS
GML
DXF
Good formats, local and
indexable
Shapefile
Directory of
shapefiles
SDE
Spatial databases:
PostGIS, Oracle
Spatial, DB2, SQL
server, MySQL*
18. DBMS checklist
FOSS4G 2015, Seoul
14th-19th September 2015
Choose PostGIS if you can
Rich support for complex native filters
Use connection pooling
Validate connections (with proper pooling)
Table Clustering
Spatial Indexing
Spatial Indexing
Spatial Indexing
Alphanumeric Indexing
Alphanumeric Indexing
Alphanumeric Indexing
Did we mention indexes?
19. Connection pooling tricks
FOSS4G 2015, Seoul
14th-19th September 2015
Connection pool size should be proportional to the
number of concurrent requests you want to serve (obvious
no?)
Activate connection validation
Mind networking tools that might cut connections sitting
idle (yes, your server is not always busy), they might cut
the connection in “bad” ways (10 minutes timeout before
the pool realizes the TCP connection attempt gives up)
Read more at http://geoserver.geo-
solutions.it/edu/en/adv_gsconfig/db_pooling.html
20. Shapefile preparation
FOSS4G 2015, Seoul
14th-19th September 2015
Remove .qix file if present (GeoServer will recreate it,
sometimes better optimized)
If there are large DBF attributes that are not in use, get
rid of them using ogr2ogr, e.g.:
ogr2ogr -select FULLNAME,MTFCC arealm.shp
tl_2010_08013_arealm.shp
If on Linux, enable memory mapping, faster, more
scalable (but will kill Windows):
21. Shapefile filtering
FOSS4G 2015, Seoul
14th-19th September 2015
Stuck with shapefiles and have scale dependent
rules like the following?
Show highways first
Show all streets when zoomed in
Use ogr2ogr to build two shapefiles, one with just
the highways, one with everything, and build two
layers, e.g.:
ogr2ogr -sql "SELECT * FROM
tl_2010_08013_roads WHERE MTFCC in
('S1100', 'S1200')" primaryRoads.shp
tl_2010_08013_roads.shp
Or hire us to develop non-spatial indexing for
shapefile!
23. Use scale dependencies
FOSS4G 2015, Seoul
14th-19th September 2015
Never show too much data
the map should be readable, not a graphic blob. Rule of
thumb: 1000 features max in the display, have labels show
up when zoomed in
Show details as you zoom in
Eagerly add MinScaleDenominator to your SLD rules
Add more expensive rendering when there are less
features
Key to get both a good looking and fast map
24. Labeling
FOSS4G 2015, Seoul
14th-19th September 2015
Labeling conflict resolution is expensive, limit to the
most inner zooms
Halo is important for readability, but adds overhead
Careful with maxDisplacement, makes for various
label location attempts
25. FeatureTypeStyle
FOSS4G 2015, Seoul
14th-19th September 2015
GeoServer uses SLD FeatureTypeStyle objects as Z
layers for painting
Each one allocates its own rendering surface (which
can use a lot of memory), use as few as possible
26. z-ordering
FOSS4G 2015, Seoul
14th-19th September 2015
Use DBMS as the data source
Add indexes on the fields used for z-ordering
If at all possible, use cross-feature type and cross-layer
z-ordering on small amounts of data (we need to go
back and forth painting it)
28. Tile caching with GWC
FOSS4G 2015, Seoul
14th-19th September 2015
Tile oriented maps, fixed zoom levels and fixed grid
Useful for stable layers, backgrounds
Protocols: WMTS, TMS, WMS-C, Google Maps/Earth,
VE
Speedup compared to dynamic WMS: 10 to 100 times,
assuming tiles are already cached (whole layer pre-
seeded)
Suitable for:
Mostly static layer
No/few dynamic parameters (CQL filters, SLD
params, SQL query params, time/elevation,
format options)
29. Embedded GWC advantage
FOSS4G 2015, Seoul
14th-19th September 2015
No double encoding when using meta-tiling, faster
seeding
30. Space considerations
FOSS4G 2015, Seoul
14th-19th September 2015
Seeding Colorado, assuming 8 cores, one layer, 0.1 sec
756x756 metatile, 15KB for each tile
Do yours: http://tinyurl.com/3apkpss
Not enough disk space? Set a disk quota
Zoom
level
Tile count Size (MB)
Time to seed
(hours)
Time to
seed (days)
13 58,377 1 0 0
14 232,870 4 0 0
15 929,475 14 0 0
16 3,713,893 57 1 0
17 14,855,572 227 6 0
18 59,396,070 906 23 1
19 237,584,280 3,625 92 4
20 950,273,037 14,500 367 15
31. Client side cache
FOSS4G 2015, Seoul
14th-19th September 2015
Client-side caching of tiles
Does not work with browsers in private mode
<expireClientsList>
<expirationRule minZoom="0" expiration="7200" />
<expirationRule minZoom="10" expiration="600" />
</expireClientsList>
32. Choose the right format
FOSS4G 2015, Seoul
14th-19th September 2015
Use the right formats
JPEG for background data (e.g. ortos)
PNG8 + precomputed palette for
background data (e.g. ortos)
PNG8 full for overlays with transparency
The format impacts also the disk space
needed! (as well as the generation time)
Check this blog post
33. Keep an eye on vector tiles
FOSS4G 2015, Seoul
14th-19th September 2015
New community module to support vector tiles
Still new, but:
PNG encoding is often 50% of the request
time when there is little data in the tile
Gone with Vector tiles
Vector tiles are more compact
35. Resource limits
FOSS4G 2015, Seoul
14th-19th September 2015
Limit the amount of resources dedicated to an
individual request
Improve fairness between requests, by preventing
individual requests from hijacking the server and/or
running for a very long time
EXTREMELY IMPORTANT in production environment
WHEN TO TWEAK THEM?
Frequent OOM Errors despite plenty of RAM
Requests that keep running for a long time (e.g.
CPU usage peaks even if no requests are being
sent)
DB Connection being killed by the DBMS while in
usage (ok, you might also need to talk to the DBA..)
37. Control-flow
FOSS4G 2015, Seoul
14th-19th September 2015
Control how many requests are executed in parallel,
queue others:
Increase throughput
Control memory usage
Enforce fairness
More info here
38. Control-flow
FOSS4G 2015, Seoul
14th-19th September 2015
$GEOSERVER_DATA_DIR/controlflow.properties
# don't allow more than 16 GetMap requests in parallel
ows.wms.getmap=16
39. JVM and deploy configuration
FOSS4G 2015, Seoul
14th-19th September 2015
40. Premise
FOSS4G 2015, Seoul
14th-19th September 2015
There is no “GO FAST!” option in the Java
Virtual Machine
The options discussed here are not going to
help if you did not prepare the data and the
styles
They are finishing touches that can get
performance up once the major data
bottlenecks have been dealt with
Check “Running in production” instructions
here
41. JVM settings
FOSS4G 2015, Seoul
14th-19th September 2015
--server: enables the server JIT compiler
--Xms2048m -Xmx2048m: sets the JVM use
two gigabytes of memory
--XX:+UseParallelOldGC -
XX:+UserParallelGC: enables multi-threaded
garbage collections, useful if you have more
than two cores
--XX:NewRatio=2: informs the JVM there will
be a high number of short lived objects
--XX:+AggressiveOpt: enable experimental
optimizations that will be defaults in future
versions of the JVM
42. Raster subsystem configuration
FOSS4G 2015, Seoul
14th-19th September 2015
Install the TurboJPEG extension
Enable JAI Mosaicking native
acceleration
Give JAI enough memory
Don’t raise JAI memory
Threshold too high
Rule of thumb: use 2 X #Core
Tile Threads (check next slide)
Play with tile Recycling against
your workflows (might help,
might not)
43. Marlin renderer
FOSS4G 2015, Seoul
14th-19th September 2015
The OpenJDK Java2D renderer scales up, but it’s not
super-fast when the load is small (1 request at a time)
The Oracle JDK Java2D renderer is fast for the single
request, but does not scale up
Marlin-renderer to the rescue:
https://github.com/bourgesl/marlin-renderer
Being considered
for merging in
OpenJDK (9 or 10)
44. Upgrade!
FOSS4G 2015, Seoul
14th-19th September 2015
Performance tends to go up version by version
Please do use a recent GeoServer version
FOSS4G 2010 vector benchmark with different
versions of GeoServer