Setting up a GeoServer can sometimes be deceptively simple. However, going from proof of concept to production requires a number of steps to be taken in order to optimize the server in terms of availability, performance and scalability. This presentation will show how to get from a basic set up to a battle ready, rock solid installation by showing the ropes an advanced user already mastered.
Setting up a GeoServer can sometimes be deceptively simple. However, going from proof of concept to production requires a number of steps to be taken in order to optimize the server in terms of availability, performance and scalability. The presentation will show how to get from a basic set up to a battle ready, rock solid installation by showing the ropes an advanced user already mastered.
GeoServer on Steroids at FOSS4G Europe 2014GeoSolutions
Setting up a GeoServer can sometimes be deceptively simple. However, going from proof of concept to production requires a number of steps to be taken in order to optimize the server in terms of availability, performance and scalability.
The presentation will show how to get from a basic setup to a battle ready, rock solid installation by showing the ropes an advanced user already mastered.
Raster data in GeoServer and GeoTools: Achievements, issues and future devel...GeoSolutions
The purpose of this presentation is, on a side, to dissect the developments performed during last year as far as raster data support in GeoTools and GeoServer is concerned, while on the other side to introduce and discuss the future development directions.
Advancements and improvements for the management of raster mosaic and pyramids will be introduced and analyzed, as well as the latest developments for the exploitation of GDAL raster sources.
Extensive details will be provided on the latest updates for the management of multidimensional raster data used in the Remote Sensing and MetOc fields.
The presentation will also introduce and provide updates on the JAITools and ImageIO-Ext projects. JAITools provides a number of new raster data analysis operators, including powerful and fast raster algebra support. ImageIO-Ext bridges the gap across the Java world and native raster data access libraries providing high performance access to GDAL, Kakadu and other libraries.
The presentation will wrap up providing an overview of unresolved issues and challenges that still need to be addressed, suggesting tips and workarounds allowing to leverage the full potential of the systems.
GeoServer in Production: we do it, here is how!GeoSolutions
The presentation will describe how to setup a production system based on GeoServer from the points of view of performance, availability and security. The suggestions will start covering how a single node GeoServer should be prepared for internet usage, tuning logging, connection pools, security, data and JVM preparation, keeping disk, memory and CPU usage in check within the limits of the available resources. We’ll then move to tools used to monitor the production instances, ranging from probes to request auditing and watch-dogs. Finally the presentation will cover setting up a cluster of server and the strategies for keeping them in synch, from the traditional multi-tier setup (testing vs production) to the systems that need to keep an ever evolving catalog of layers constantly on-line and in synch.
Advanced GeoServer Security with GeoFenceGeoSolutions
This presentation will provide an introduction to GeoFence, an open source tool to configure and use complex authorization rules to protect data served by GeoServer OGC services.
Creating Stunning Maps in GeoServer: mastering SLD and CSS stylesGeoSolutions
Various software can style maps and generate a proper SLD document for OGC compliant WMS like GeoServer to use. However, in most occasions, the styling allowed by the graphical tools is pretty limited and not good enough to achieve good looking, readable and efficient cartographic output. For those that like to write their own styles CSS also represents a nice alternatives thanks to its compactness and expressiveness.
Several topics will be covered, providing examples in both SLD and CSS for each, including: mastering multi-scale styling, using GeoServer extensions to build common hatch patterns, line styling beyond the basics, such as cased lines, controlling symbols along a line and the way they repeat, leveraging TTF symbol fonts and SVGs to generate good looking point thematic maps, using the full power of GeoServer label lay-outing tools to build pleasant, informative maps on both point, polygon and line layers, including adding road plates around labels, leverage the labeling subsystem conflict resolution engine to avoid overlaps in stand alone point symbology, blending charts into a map, dynamically transform data during rendering to get more explicative maps without the need to pre-process a large amount of views.
The presentation aims to provide the attendees with enough information to master SLD/CSS documents and most of GeoServer extensions to generate appealing, informative, readable maps that can be quickly rendered on screen.
Review this presentation to learn what it means to support a spatial database, and start to see the power of answering spatial questions inside a Postgres database.
Setting up a GeoServer can sometimes be deceptively simple. However, going from proof of concept to production requires a number of steps to be taken in order to optimize the server in terms of availability, performance and scalability. The presentation will show how to get from a basic set up to a battle ready, rock solid installation by showing the ropes an advanced user already mastered.
GeoServer on Steroids at FOSS4G Europe 2014GeoSolutions
Setting up a GeoServer can sometimes be deceptively simple. However, going from proof of concept to production requires a number of steps to be taken in order to optimize the server in terms of availability, performance and scalability.
The presentation will show how to get from a basic setup to a battle ready, rock solid installation by showing the ropes an advanced user already mastered.
Raster data in GeoServer and GeoTools: Achievements, issues and future devel...GeoSolutions
The purpose of this presentation is, on a side, to dissect the developments performed during last year as far as raster data support in GeoTools and GeoServer is concerned, while on the other side to introduce and discuss the future development directions.
Advancements and improvements for the management of raster mosaic and pyramids will be introduced and analyzed, as well as the latest developments for the exploitation of GDAL raster sources.
Extensive details will be provided on the latest updates for the management of multidimensional raster data used in the Remote Sensing and MetOc fields.
The presentation will also introduce and provide updates on the JAITools and ImageIO-Ext projects. JAITools provides a number of new raster data analysis operators, including powerful and fast raster algebra support. ImageIO-Ext bridges the gap across the Java world and native raster data access libraries providing high performance access to GDAL, Kakadu and other libraries.
The presentation will wrap up providing an overview of unresolved issues and challenges that still need to be addressed, suggesting tips and workarounds allowing to leverage the full potential of the systems.
GeoServer in Production: we do it, here is how!GeoSolutions
The presentation will describe how to setup a production system based on GeoServer from the points of view of performance, availability and security. The suggestions will start covering how a single node GeoServer should be prepared for internet usage, tuning logging, connection pools, security, data and JVM preparation, keeping disk, memory and CPU usage in check within the limits of the available resources. We’ll then move to tools used to monitor the production instances, ranging from probes to request auditing and watch-dogs. Finally the presentation will cover setting up a cluster of server and the strategies for keeping them in synch, from the traditional multi-tier setup (testing vs production) to the systems that need to keep an ever evolving catalog of layers constantly on-line and in synch.
Advanced GeoServer Security with GeoFenceGeoSolutions
This presentation will provide an introduction to GeoFence, an open source tool to configure and use complex authorization rules to protect data served by GeoServer OGC services.
Creating Stunning Maps in GeoServer: mastering SLD and CSS stylesGeoSolutions
Various software can style maps and generate a proper SLD document for OGC compliant WMS like GeoServer to use. However, in most occasions, the styling allowed by the graphical tools is pretty limited and not good enough to achieve good looking, readable and efficient cartographic output. For those that like to write their own styles CSS also represents a nice alternatives thanks to its compactness and expressiveness.
Several topics will be covered, providing examples in both SLD and CSS for each, including: mastering multi-scale styling, using GeoServer extensions to build common hatch patterns, line styling beyond the basics, such as cased lines, controlling symbols along a line and the way they repeat, leveraging TTF symbol fonts and SVGs to generate good looking point thematic maps, using the full power of GeoServer label lay-outing tools to build pleasant, informative maps on both point, polygon and line layers, including adding road plates around labels, leverage the labeling subsystem conflict resolution engine to avoid overlaps in stand alone point symbology, blending charts into a map, dynamically transform data during rendering to get more explicative maps without the need to pre-process a large amount of views.
The presentation aims to provide the attendees with enough information to master SLD/CSS documents and most of GeoServer extensions to generate appealing, informative, readable maps that can be quickly rendered on screen.
Review this presentation to learn what it means to support a spatial database, and start to see the power of answering spatial questions inside a Postgres database.
GeoServer, an introduction for beginnersGeoSolutions
This presentation will provide an introduction to the GeoServer project and its abilities to publish data with a mix of well known OGC protocols and other pupolar protocol and data formats, including:
* Setting up vector and raster data from the GeoServer administration control
* Publishing data via WMS, WFS and WCS
* Styling layers using desktop tools, with a carousel of GeoServer mapping abilities
* Tile caching with WMTS
* Moving to data processing with WPS
* Brief introduction to security
Advanced Security with GeoServer - FOSS4G 2015GeoSolutions
The presentation will provide an introduction to GeoServer own authentication and authorization subsystems. We’ll cover the supported authentication protocols, such as from basic/digest authentication and CAS support, check through the various identity providers, such as local config files, database tables and LDAP servers, and how it’s possible to combine the various bits in a single comprehensive authentication tool, as well as providing examples of custom authentication plugins for GeoServer, integrating it in a home grown security architecture.
We’ll then move on to authorization, describing the GeoServer pluggable authorization mechanism and comparing it with proxy based solution, and check the built in service and data security system, reviewing its benefits and limitations.
Finally we’ll explore the advanced authentication provider, GeoFence, explore the levels on integration with GeoSErver, from the simple and seamless direct integration to the more sophisticated external setup, and see how it can provide GeoServer with complex authorization rules over data and OGC services, taking into account the current user, OGC request and requested layers to enforce spatial filters and alphanumeric filters, attribute selection as well as cropping raster data to areas of interest.
Mastering Security with GeoServer and GeoFence - FOSS4G EU 2017GeoSolutions
The presentation will provide an introduction to GeoServer own authentication and authorization subsystems. We’ll cover the supported authentication protocols, such as from basic/digest authentication and CAS support, check through the various identity providers, such as local config files, database tables and LDAP servers, and how it’s possible to combine the various bits in a single comprehensive authentication tool, as well as providing examples of custom authentication plugins for GeoServer, integrating it in a home grown security architecture. We’ll then move on to authorization, describing the GeoServer pluggable authorization mechanism and comparing it with proxy based solution, and check the built in service and data security system, reviewing its benefits and limitations. Finally we’ll explore the advanced authentication provider, GeoFence, explore the levels on integration with GeoServer, from the simple and seamless direct integration to the more sophisticated external setup, and see how it can provide GeoServer with complex authorization rules over data and OGC services, taking into account the current user, OGC request and requested layers to enforce spatial filters and alphanumeric filters, attribute selection as well as cropping raster data to areas of interest.
Fundamentals of Remote Sensing - Introduction
What is Remote Sensing?
So, what exactly is remote sensing? For the purposes of this tutorial, we will use the following definition:
"Remote sensing is the science (and to some extent, art) of acquiring information about the Earth's surface without actually being in contact with it. This is done by sensing and recording reflected or emitted energy and processing, analyzing, and applying that information."
In much of remote sensing, the process involves an interaction between incident radiation and the targets of interest. This is exemplified by the use of imaging systems where the following seven elements are involved. Note, however that remote sensing also involves the sensing of emitted energy and the use of non-imaging sensors.
GeoSolutions has been involved into a number of projects, ranging from local administrations to global institutions, involving GeoNode deployments, customizations and enhancements. A gallery of projects and use cases will showcase the versatility and effectiveness of GeoNode, both as a standalone application and as a service component, for building secured geodata catalogs and web mapping services. Lastly, ongoing and future developments will be presented ranging from the upcoming integration with MapStore to the monitoring and analytics dashboard or the support for time series data.
GeoServer an introduction for beginnersGeoSolutions
This presentation will provide an introduction to the GeoServer project and its abilities to publish data with a mix of well-known OGC protocols and other popular protocols and data formats.
Oracle AHF Insights 23c - Deeper Diagnostic Insights for your Oracle Database...Sandesh Rao
AHF Insights provides a bird's eye view of the entire system with the ability to further drill down for root cause analysis. AHF performs a diagnostic collection for a given period to analyze the performance of database systems from:
• Configuration
• Environment Topology • Metrics
• Logs
Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...GeoSolutions
The purpose of this presentation is to discuss the developments during last years in raster data support in GeoTools and GeoServer, and also to introduce and discuss future development directions.
Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...GeoSolutions
This presentation will provide the attendee with an introduction to data processing in GeoServer by means of WPS, rendering transformations and SQL views, describing real applications and how these facilities were used in them.
We'll start with the basic WPS capabilities, showing how to build processing request based on existing processes and how to build new processes leveraging scripting languages, and introducing unique GeoServer integration features, showing how processing can seamlessly integrate directly in the GeoServer data sources and complement existing services.
We'll also discuss how to integrate on the fly processing in WMS requests, achieving high performance data displays without having to pre-process the data in advance, and allowing the caller to interactively choose processing parameters.
While the above shows how to make GeoServer perform the work, the processing abilities of spatial databases should not be forgotten, so we’ll show how certain classes of processing can be achieved directly in the database.
At the end the attendee will be able to easily issue WPS requests both for Vectors and Rasters to GeoServer through the WPS Demo Builder, enrich SLDs with on-the-fly rendering transformations and play with SQL views in order to create dynamic layers.
Serving earth observation data with GeoServer: addressing real world requirem...GeoSolutions
The presentation will cover GeoSolutions experience in setting up GeoServer based production systems providing access to earth observation products, with indications of technical challenges, solutions, and deployment suggestion. The presentations will cover topics such as setting up a single unified mosaic from all the available data sources, tailoring access to it to different users, determining the most appropriate stacking order, dealing with multiresolution, different coordinate systems, multiband data, SAR integration, searching for the most appropriate products using a mix of WFS, CSW and so on, serving imagery with high performance WMS and WMTS, performing small and large data extractions with WCS and WPS, closing up with deployment examples and suggestions.
Symbology and Classifying data in ARC GISKU Leuven
Right-click the geostatistical layer in the ArcMap table of contents that you want to classify and click Properties.
Click the Symbology tab.
Click Classify.
Click the Method arrow and choose a classification method.
Setting up a GeoServer can sometimes be deceptively simple. However, going from proof-of-concept to production requires a number of steps to be taken in order to optimize the server in terms of availability, performance and scalability. The presentation will show how to get from a basic setup to a battle-ready, rock-solid installation.
WMS Benchmarking presentation and results, from the FOSS4G 2010 event in Barcelona. 8 different development teams participated in this exercise, to display common data through the WMS standard the fastest. http://2010.foss4g.org/wms_benchmarking.php
GeoServer, an introduction for beginnersGeoSolutions
This presentation will provide an introduction to the GeoServer project and its abilities to publish data with a mix of well known OGC protocols and other pupolar protocol and data formats, including:
* Setting up vector and raster data from the GeoServer administration control
* Publishing data via WMS, WFS and WCS
* Styling layers using desktop tools, with a carousel of GeoServer mapping abilities
* Tile caching with WMTS
* Moving to data processing with WPS
* Brief introduction to security
Advanced Security with GeoServer - FOSS4G 2015GeoSolutions
The presentation will provide an introduction to GeoServer own authentication and authorization subsystems. We’ll cover the supported authentication protocols, such as from basic/digest authentication and CAS support, check through the various identity providers, such as local config files, database tables and LDAP servers, and how it’s possible to combine the various bits in a single comprehensive authentication tool, as well as providing examples of custom authentication plugins for GeoServer, integrating it in a home grown security architecture.
We’ll then move on to authorization, describing the GeoServer pluggable authorization mechanism and comparing it with proxy based solution, and check the built in service and data security system, reviewing its benefits and limitations.
Finally we’ll explore the advanced authentication provider, GeoFence, explore the levels on integration with GeoSErver, from the simple and seamless direct integration to the more sophisticated external setup, and see how it can provide GeoServer with complex authorization rules over data and OGC services, taking into account the current user, OGC request and requested layers to enforce spatial filters and alphanumeric filters, attribute selection as well as cropping raster data to areas of interest.
Mastering Security with GeoServer and GeoFence - FOSS4G EU 2017GeoSolutions
The presentation will provide an introduction to GeoServer own authentication and authorization subsystems. We’ll cover the supported authentication protocols, such as from basic/digest authentication and CAS support, check through the various identity providers, such as local config files, database tables and LDAP servers, and how it’s possible to combine the various bits in a single comprehensive authentication tool, as well as providing examples of custom authentication plugins for GeoServer, integrating it in a home grown security architecture. We’ll then move on to authorization, describing the GeoServer pluggable authorization mechanism and comparing it with proxy based solution, and check the built in service and data security system, reviewing its benefits and limitations. Finally we’ll explore the advanced authentication provider, GeoFence, explore the levels on integration with GeoServer, from the simple and seamless direct integration to the more sophisticated external setup, and see how it can provide GeoServer with complex authorization rules over data and OGC services, taking into account the current user, OGC request and requested layers to enforce spatial filters and alphanumeric filters, attribute selection as well as cropping raster data to areas of interest.
Fundamentals of Remote Sensing - Introduction
What is Remote Sensing?
So, what exactly is remote sensing? For the purposes of this tutorial, we will use the following definition:
"Remote sensing is the science (and to some extent, art) of acquiring information about the Earth's surface without actually being in contact with it. This is done by sensing and recording reflected or emitted energy and processing, analyzing, and applying that information."
In much of remote sensing, the process involves an interaction between incident radiation and the targets of interest. This is exemplified by the use of imaging systems where the following seven elements are involved. Note, however that remote sensing also involves the sensing of emitted energy and the use of non-imaging sensors.
GeoSolutions has been involved into a number of projects, ranging from local administrations to global institutions, involving GeoNode deployments, customizations and enhancements. A gallery of projects and use cases will showcase the versatility and effectiveness of GeoNode, both as a standalone application and as a service component, for building secured geodata catalogs and web mapping services. Lastly, ongoing and future developments will be presented ranging from the upcoming integration with MapStore to the monitoring and analytics dashboard or the support for time series data.
GeoServer an introduction for beginnersGeoSolutions
This presentation will provide an introduction to the GeoServer project and its abilities to publish data with a mix of well-known OGC protocols and other popular protocols and data formats.
Oracle AHF Insights 23c - Deeper Diagnostic Insights for your Oracle Database...Sandesh Rao
AHF Insights provides a bird's eye view of the entire system with the ability to further drill down for root cause analysis. AHF performs a diagnostic collection for a given period to analyze the performance of database systems from:
• Configuration
• Environment Topology • Metrics
• Logs
Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...GeoSolutions
The purpose of this presentation is to discuss the developments during last years in raster data support in GeoTools and GeoServer, and also to introduce and discuss future development directions.
Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...GeoSolutions
This presentation will provide the attendee with an introduction to data processing in GeoServer by means of WPS, rendering transformations and SQL views, describing real applications and how these facilities were used in them.
We'll start with the basic WPS capabilities, showing how to build processing request based on existing processes and how to build new processes leveraging scripting languages, and introducing unique GeoServer integration features, showing how processing can seamlessly integrate directly in the GeoServer data sources and complement existing services.
We'll also discuss how to integrate on the fly processing in WMS requests, achieving high performance data displays without having to pre-process the data in advance, and allowing the caller to interactively choose processing parameters.
While the above shows how to make GeoServer perform the work, the processing abilities of spatial databases should not be forgotten, so we’ll show how certain classes of processing can be achieved directly in the database.
At the end the attendee will be able to easily issue WPS requests both for Vectors and Rasters to GeoServer through the WPS Demo Builder, enrich SLDs with on-the-fly rendering transformations and play with SQL views in order to create dynamic layers.
Serving earth observation data with GeoServer: addressing real world requirem...GeoSolutions
The presentation will cover GeoSolutions experience in setting up GeoServer based production systems providing access to earth observation products, with indications of technical challenges, solutions, and deployment suggestion. The presentations will cover topics such as setting up a single unified mosaic from all the available data sources, tailoring access to it to different users, determining the most appropriate stacking order, dealing with multiresolution, different coordinate systems, multiband data, SAR integration, searching for the most appropriate products using a mix of WFS, CSW and so on, serving imagery with high performance WMS and WMTS, performing small and large data extractions with WCS and WPS, closing up with deployment examples and suggestions.
Symbology and Classifying data in ARC GISKU Leuven
Right-click the geostatistical layer in the ArcMap table of contents that you want to classify and click Properties.
Click the Symbology tab.
Click Classify.
Click the Method arrow and choose a classification method.
Setting up a GeoServer can sometimes be deceptively simple. However, going from proof-of-concept to production requires a number of steps to be taken in order to optimize the server in terms of availability, performance and scalability. The presentation will show how to get from a basic setup to a battle-ready, rock-solid installation.
WMS Benchmarking presentation and results, from the FOSS4G 2010 event in Barcelona. 8 different development teams participated in this exercise, to display common data through the WMS standard the fastest. http://2010.foss4g.org/wms_benchmarking.php
State of GeoServer reviewing the new and noteworthy features introduced in the past year. The project has an aggressive six month release cycle with GeoServer 2.7 and 2.8 being released this year.
These releases bring together exciting new features. A lot of work has been done on processing services with clustering, security and processing control.
The rendering engine continues to improve with the addition of color blending opening up a range of creative possibilities. The CSS extension (used to easily generate OGC standard styles) has been cleaned up with a rewrite.
This talk will highlighted updates on data import, application schema use, data transforms and the latest from the developer list.
Attend this talk for a cheerful update on what is happening with this popular OSGeo project. Whether you are an expert user, a developer, or simply curious what these projects can do for you, this talk is for you.
View the slides of our launch day unveiling of FME 2013. You’ll see directly from Safe’s co-founders on what’s new in FME 2013 and why we believe it’s the best release yet.
State of GeoServer provides an update on our community and reviews the new and noteworthy features for the Project. The community keeps an aggressive six month release cycle with GeoServer 2.8 and 2.9 being released this year.
Each releases bring together exciting new features. This year a lot of work has been done on the user interface, clustering, security and compatibility with the latest Java platform. We will also take a look at community research into vector tiles, multi-resolution raster support and more.
Attend this talk for a cheerful update on what is happening with this popular OSGeo project. Whether you are an expert user, a developer, or simply curious what these projects can do for you, this talk is for you.
An Introduction to Google Colab as a development Platform using Python as a programming language. Mentioning Tips that are beneficial to make the development experience much easier.
Spatio-temporal Data Handling With GeoServer for MetOc And Remote SensingGeoSolutions
This presentation will provide detailed information on how to handle SpatioTemporal metadata in GeoServer for serving with OGC Services, with a particular focus on WMS and WCS.
Damien Pobel, expert technique PHP chez Smile, a animé une conférence sur le thème des front-end performances avec eZ Publish.
Les slides de sa présentation exposant quelques spécificités liées à eZ Publish sont disponibles ici.
In this presentation, you will see some of the problems SAP PI/PO upgrades, Support Packs, and Patches. You will learn some of the problems about applying them and how to get it fixed.
The best way to ensure you are testing it is to use an automated tool to setup the test cases and run them.
There is a demo on using Figaf IRT to setup the tests in it.
You can try the tool self at https://figaf.com/IRT
A talk about the OSGeo Live project; covering 43 projects that are available in a live DVD format (for you to run without installing). The project is much improved with OGC documentation and a description of many of the projects. New this year (thanks to some sponsorship) is quickstarts for several of the projects.
Presentation in GNOME Asia 2015 which focus in the topic of "In Memory Computing" with the tittle An Overview, Maximize the Ability of The GNU/LINUX Operating System using In Memory Computation for Academic, Business and Government.
This paper are mainly focus in moving the root file system from storage device into memory (RAM) device, minimizing bottleneck and maximizing performance, benchmarking and a little snippet script how to do that.
MapStore 2 is an Open Source webmapping framework which uses ReactJS, Redux, OpenLayers, Leaflet and Cesium.
It supports various OGC Protocols like CSW, WMS, WFS and WMTS and allows end users to create charts and dashboards thanks to its integration with GeoServer.
This presentation has been prepared with the objective to give readers a quick introduction to the Open Source GeoNode platform and its functionalities for the creation of a Spatial Data Infrastructure completely based on open Source components.
Serving earth observation data with GeoServer: addressing real world requirem...GeoSolutions
Information on the latest developments in GeoServer for the support for Earth Observation data with support for the various OGC services and OpenSearch.
This presentation goes over the most important features of GeoServer in order to give the reader an intro about what is good and what is super-good about GeoServer!
The current version reflects the presentation given at FOSS4G 2017 in Boston.
State of GeoServer provides an update on our community and reviews the new and noteworthy features for the Project. The community keeps an aggressive six month release cycle with GeoServer 2.11 and 2.12 being released this year. Each releases bring together exciting new features. This year a lot of work has been done on startup times, large catalogs, REST configuration upgrades, styling languages, styling interface, security,just to name a few. We will also take a look at community research into satellite imagery search and delivery, multi-resolution raster support and more. Attend this talk for a cheerful update on what is happening with this popular OSGeo project. Whether you are an expert user, a developer, or simply curious what these projects can do for you, this talk is for you.
MapStore 2, modern mashups with OL3, Leaflet and ReactGeoSolutions
MapStore 2 is an overhaul of the existing MapStore with the goal of creating a webmapping framework which is more lightweight but still modular and easy to work with. It can leverage both OpenLayers 3 or Leaflet as the mapping engine and uses ReactJS and Redux as the core JavaScript libraries. Moreover a 3D viewer based on CesiumJS is available.
MapStore 2 is both a framework and a standalone application. You can use it as a framework to develop your custom WebGis application composing MapStore ReactJS components and components from other libraries (like React Bootstrap), choosing the best mapping library for your purposes. You can also use the MapStore2 application directly, to create, save, and share in a simple and intuitive way maps and mashups created by selecting content from the server such as Google Maps, OpenStreetMap or WMS and WMTS.
The MapStore 2 application consists of two main components MapManager and GeoStore, respectively front-end and back-end. MapManager allows through a unique interface to create, modify, delete and search on maps definition as well as generate a univoque link to embed a map in an external website, share your own maps with the others. GeoStore implements a flexible Java Enterprise infrastructure to manage and search maps with proper management of authentication and authorization.
The presentation will give the audience an extensive overview of the MapStore 2 functionalities for the creation of mapping portals. Eventually, a range of GeoSolutions case studies of MapStore 2 will be presented.
State of GeoServer provides an update on our community and reviews the new and noteworthy features for the Project. The community keeps an aggressive six month release cycle with GeoServer 2.8 and 2.9 being released this year.
Each releases bring together exciting new features. This year a lot of work has been done on the user interface, clustering, security and compatibility with the latest Java platform. We will also take a look at community research into vector tiles, multi-resolution raster support and more.
Attend this talk for a cheerful update on what is happening with this popular OSGeo project. Whether you are an expert user, a developer, or simply curious what these projects can do for you, this talk is for you.
Raster Data In GeoServer and GeoTools: Achievements, Issues And Future Develo...GeoSolutions
The purpose of this presentation is, on a side, to dissect the developments performed during last year as far as raster data support in GeoTools and GeoServer is concerned, while on the other side to introduce and discuss the future development directions.
Advancements and improvements for the management of multidimensional raster data (NetCDF, GRIB, HDF) and mosaic thereof will be introduced, as well as the available ways to manage sliding windows of data via the REST API and importer.
Extensive details will be provided on the latest updates for the management of multidimensional raster data used in the Remote Sensing and MetOc fields, including support for WCS EO and WMS EO, and some considerations on the WCS MetOc extensions.
The presentation will also introduce and provide updates on jai-ext, imageio-ext, and JAITools. jai-ext provides extended JAI operators that correctly handle NODATA and regione of interests (masks), JAITools provides a number of new raster data analysis operators, including powerful and fast raster algebra support, while ImageIO-Ext bridges the gap across the Java world and native raster data access libraries providing high performance access to GDAL, Kakadu and other libraries.
The presentation will wrap up providing an overview of unresolved issues and challenges that still need to be addressed, suggesting tips and workarounds allowing to leverage the full potential of the systems.
Mapping the world beyond web mercator - FOSS4G 2015GeoSolutions
Most popular mapping presentations today, ranging from clients to servers, show and discuss only maps in EPSG:3857, the popular Mercator derived projection used by OSM as well as
most commercial tiles providers.
There is however an interesting, exciting world of map projections out there, that are still being used in a variety of context. This presentation will introduce the advancement made in GeoTools and GeoServer to handle those use cases, where users have a worldwide data set, and need to view all or part of it in multiple projections, some of which valid in a limited area, and requiring the software to perform a proper display of it on the fly, without any preparation.
We’ll discuss GeoTools/GeoServer “advanced projection handling” manages to deal with these cases, wrapping data, dealing with the poles and the dateline, cutting on the fly excess data, densifying on the fly long lines as needed to ensure a smooth reprojection, for a variety of cases, ranging from seemingly innocuous datum shifts, maps having the prime meridian over the pacific, and the various tricks to properly handle stereographic, transverse mercator, Lambert conic and other limited area projections against world wide source data sets.
GeoServer for Spatio-temporal Data Handling With Examples For MetOc And Remot...GeoSolutions
This presentation will provide detailed information on how to ingest and configure SpatioTemporal in GeoServer to be served using OGC services, with examples from WMS and WCS services.
Topics covered are as follows:
- Discussion over existing data formats and how to preprocess them for best serving with GeoServer
- Configuring SpatioTemporal raster and vector data in GeoServer
- Serving SpatioTemporal raster and vector data with OGC Services
- Tips and techniques to optimize performance and allow maximum exploitation of the available data
The attendees will be provided with the basic knowledge needed to preprocess and ingest the most common spatiotemporal data from the MetOc and Remote Sensing field for serving via GeoServer.
Advanced Cartographic Map Rendering in GeoServerGeoSolutions
Various software can style maps and generate a proper SLD document for OGC compliant WMS like GeoServer to use. However, in most occasions, the styling allowed by the graphical tools is pretty limited and not good enough to achieve good looking, readable and efficient cartographic output. For those that like to write their own styles CSS also represents a nice alternatives thanks to its compact-ness and expressiveness.
Several topics will be covered, providing examples in both SLD and CSS for each, including: mastering multi-scale styling, using GeoServer extensions to build common hatch patterns, line styling beyond the basics, such as cased lines, controlling symbols along a line and the way they repeat, leveraging TTF symbol fonts and SVGs to generate good looking point thematic maps, using the full power of GeoServer label lay-outing tools to build pleasant, informative maps on both point, polygon and line layers, including adding road plates around labels, leverage the labelling subsystem conflict resolution engine to avoid overlaps in stand alone point symbology, blending charts into a map, dynamically transform data during rendering to get more explicative maps without the need to pre-process a large amount of views. The presentation aims to provide the attendees with enough information to master SLD/CSS documents and most of GeoServer extensions to generate appealing, informative, readable maps that can be quickly rendered on screen.
The following presentation was held by GeoSolutions founder and managing director Simone Giannecchini at GeoSpatial World Forum INSPIRE Conference in Lisbon, 2015.
The workshop will provide a hands on introduction to the basic GeoServer concepts, as well as usage and configuration, with particular attention to the setup of INSPIRE compliant view services with a demonstration set of data in various formats, both raster and vector.
The following presentation "Building Interoperable SDIs with Open Source Products" was held by GeoSolutions' founder and managing director at GeoSpatial World Forum 2015, Lisbon.
Main topics:
- GeoSolutions' presentation
- GeoSolutions' expertise
- GeoSolutions' products (GeoServer, GeoNetwork, MapStore)
- GeoSolutions' main clients
Presentation about GeoServer helded by GeoSolutions technical lead Mauro Bartolomeoli at GeoBusiness 2015, London.
Main topics:
-Quick intro to GeoServer
-What’s new in the 2.6.x and 2.7.x series
-What’s cooking for the future
Introduzione a GeoServer ed ai servizi OGCGeoSolutions
Slide di Introduzione al GeoServer con particolare enfasi sui protocolli OGC da esso supportati.
La presentazione ripercorre con buon livello di dettaglio le funzionalità offerte da GeoServer proponendo dove necessario una breve introduzione ai servizi OGC da esso implementati in modo da rendere l'utente autonomo per quanto riguarda la comprensione dei concetti alla base delle funzionalità di GeoServer stesso.
The presentation will provide an introduction to GeoServer own authentication and authorization subsystems. We’ll cover the supported authentication protocols, such as from basic/digest authentication and CAS support, check through the various identity providers, such as local config files, database tables and LDAP servers, and how it’s possible to combine the various bits in a single comprehensive authentication tool, as well as providing examples of custom authentication plugins for GeoServer, integrating it in a home grown security architecture.
We’ll then move on to authorization, describing the GeoServer pluggable authorization mechanism and comparing it with proxy based solution, and check the built in service and data security system, reviewing its benefits and limitations.
Finally we’ll explore an advanced authentication tool called GeoFence, and see how it can plug into GeoServer to provide graphical configuration abilities for use complex authorization rules over data and OGC services, taking into account spatial filters, attribute filters, attribute hiding as well as cropping raster data to areas of interest. Finally we’ll show how using LDAP both GeoFence and GeoServer can use a common users database, simplifying administrators job, and provide some real world examples.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
Software Delivery At the Speed of AI: Inflectra Invests In AI-Powered QualityInflectra
In this insightful webinar, Inflectra explores how artificial intelligence (AI) is transforming software development and testing. Discover how AI-powered tools are revolutionizing every stage of the software development lifecycle (SDLC), from design and prototyping to testing, deployment, and monitoring.
Learn about:
• The Future of Testing: How AI is shifting testing towards verification, analysis, and higher-level skills, while reducing repetitive tasks.
• Test Automation: How AI-powered test case generation, optimization, and self-healing tests are making testing more efficient and effective.
• Visual Testing: Explore the emerging capabilities of AI in visual testing and how it's set to revolutionize UI verification.
• Inflectra's AI Solutions: See demonstrations of Inflectra's cutting-edge AI tools like the ChatGPT plugin and Azure Open AI platform, designed to streamline your testing process.
Whether you're a developer, tester, or QA professional, this webinar will give you valuable insights into how AI is shaping the future of software delivery.
Securing your Kubernetes cluster_ a step-by-step guide to success !KatiaHIMEUR1
Today, after several years of existence, an extremely active community and an ultra-dynamic ecosystem, Kubernetes has established itself as the de facto standard in container orchestration. Thanks to a wide range of managed services, it has never been so easy to set up a ready-to-use Kubernetes cluster.
However, this ease of use means that the subject of security in Kubernetes is often left for later, or even neglected. This exposes companies to significant risks.
In this talk, I'll show you step-by-step how to secure your Kubernetes cluster for greater peace of mind and reliability.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
91mobiles recently conducted a Smart TV Buyer Insights Survey in which we asked over 3,000 respondents about the TV they own, aspects they look at on a new TV, and their TV buying preferences.
JMeter webinar - integration with InfluxDB and GrafanaRTTS
Watch this recorded webinar about real-time monitoring of application performance. See how to integrate Apache JMeter, the open-source leader in performance testing, with InfluxDB, the open-source time-series database, and Grafana, the open-source analytics and visualization application.
In this webinar, we will review the benefits of leveraging InfluxDB and Grafana when executing load tests and demonstrate how these tools are used to visualize performance metrics.
Length: 30 minutes
Session Overview
-------------------------------------------
During this webinar, we will cover the following topics while demonstrating the integrations of JMeter, InfluxDB and Grafana:
- What out-of-the-box solutions are available for real-time monitoring JMeter tests?
- What are the benefits of integrating InfluxDB and Grafana into the load testing stack?
- Which features are provided by Grafana?
- Demonstration of InfluxDB and Grafana using a practice web application
To view the webinar recording, go to:
https://www.rttsweb.com/jmeter-integration-webinar
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
Enterprise class deployment for GeoServer and GeoWebcache Optimizing performances and robustness
1. Enterprise class deployment
for GeoServer and GeoWebcache
Optimizing performances and robustness
Ing. Mauro Bartolomeoli, GeoSolutions
Ing. Andrea Aime, GeoSolutions
Ing. Simone Giannecchini, GeoSolutions
FOSS4G-EU 2015, Como
14th July 2015
2. GeoSolutions
Italian SME
Expertise
• Image Processing, GeoSpatial Data Fusion
• Java, Java Enterprise, C++, Python
• JPEG2000, JPIP, Advanced 2D visualization
Supporting/Developing FOSS4G
MapStore, GeoServer
GeoNetwork, GeoCollect
Clients
Public Agencies
Private Companies
http://www.geo-solutions.it
FOSS4G-EU 2015, Como
14th July 2015
3. Outline
Intro to GeoServer (Optional)
Benchmarking with JMeter
Preparing raster and vector data
Optimizing styling
Output tuning
Tiling and caching
Configuring for Robustness
Deploy configurations
FOSS4G-EU 2015, Como
14th July 2015
7. Intro to GeoServer
In case you are not that familiar with it (fool!)
GeoServer Release Schedule
http://geoserver.geo-solutions.it/edu/en/install_run/releases.html
Web Administration Interface
http://geoserver.geo-solutions.it/edu/en/install_run/wai.html
GeoServer Data Directory
http://geoserver.geo-solutions.it/edu/en/adding_data/structure.html
Adding a Shapefile
http://geoserver.geo-solutions.it/edu/en/adding_data/add_shp.html
Adding a Postgis layer
http://geoserver.geo-solutions.it/edu/en/adding_data/postgis_lay.html
Adding a GeoTiff
http://geoserver.geo-solutions.it/edu/en/adding_data/add_geotiff.html
Adding a Style
http://geoserver.geo-solutions.it/edu/en/pretty_maps/add_style.html
FOSS4G-EU 2015, Como
14th July 2015
9. Benchmarking
Benchmarking is an important phase in project
development
It gives you various information about your
application:
Scalability issues
Robustness in extreme conditions
Presence of any bottleneck inside the application
Performances Test against another software
FOSS4G-EU 2015, Como
14th July 2015
10. Local Testing vs Remote Testing
Network sometimes can compromise the results of your
tests
In case of high network overload you may see low
throughput
This can be associated to a bottleneck of the
connection which results in bad performances
without concerning about the request type
For this reason, be careful to setup your remote tests
in a separate network in order to avoid network
overload
FOSS4G-EU 2015, Como
14th July 2015
11. Lookout for the bottleneck
Typical bottlenecks:
CPU: at high load all the CPUs are pegged
Disk: CPUs are not hot, the server is reading a lot
from the disk during the benchmark
Network (data sources): CPUs are not hot, but the
local network (maybe towards the DB) is at full
capacity
Network (output): all local resources are midly used,
but the outbound connection is at full capacity
Code scalability: none of the above, every resource
seems to be in light use and usage is not going up
despire higher client load
FOSS4G-EU 2015, Como
14th July 2015
12. Introduction to JMeter
Open Source performance measurement tool written in
Java
This tool will be highly used during the workshop for
testing the GeoServer performances against Benchmark
data
More informations can be found at the Jmeter site:
http://jakarta.apache.org/jmeter/
FOSS4G-EU 2015, Como
14th July 2015
13. Introduction to JMeter
Easy-to-use UI
Allows to setup multiple thread groups, different
parallelism and request count, to ramp up the load
Can use CSV files to generate semi-randomized requests
Can execute parameterized tests
Reports results in a simple table
Uses Assertions for checking test results
Can be executed in batch
FOSS4G-EU 2015, Como
14th July 2015
14. Using JMeter
Thread group: how many
threads
Loop: how many
requests
HTTP sampler: the
request
CSV: read request
params from CSV
Default: do not repeat
what’s equal in all
requests
Performance summary
FOSS4G-EU 2015, Como
14th July 2015
15. Result Summary
Results table
Run the benchmarks 2-3 times, let the results stabilize
Save the results, check other optimizations, compare the
results
FOSS4G-EU 2015, Como
14th July 2015
16. Exercise
Let's start with practice!!!
Follow the instructions on the link below
http://geoserver.geo-solutions.it/educational/en/adv_gsconfig/jmeter/jmeter_simple.html
You should be able to reproduce the test using the
GeoServer Training instance installed in your PC
This simple exercise will show you how to use JMeter with
a basic configuration for testing GeoServer performances
FOSS4G-EU 2015, Como
14th July 2015
17. Randomized Multiscale Testing
In the example before, we ran a test on a layer always
setting the same bounding box and image size
Now we should setup a more complicated test asking for
different bounding boxes and resolutions, aka Multiscale
testing
Multiscale testing is useful because it stresses GeoServer
requesting new data each time, mimicking real usage
conditions and providing better testing for your SLD scale
dependencies
With JMeter we can execute the test by passing a CSV file
containing multiple bounding boxes and image
dimensions
FOSS4G-EU 2015, Como
14th July 2015
18. Exercise
Multiscale test created using wms_request.py on a mosaic
layer
Follow the instructions on the link below
http://geoserver.geo-solutions.it/educational/en/adv_gsconfig/jmeter/jmeter_multiscale.html
This exercise will show you how to use create a CSV file
containing requests at multiple resolutions and how to run
JMeter with it
FOSS4G-EU 2015, Como
14th July 2015
20. Intro to GDAL Utilities
Online Material
http://geoserver.geo-
solutions.it/edu/en/raster_data/processing.html
http://www.gdal.org/gdal_utilities.html
FOSS4G-EU 2015, Como
14th July 2015
21. Raster Data CheckList
Objectives
Fast extraction of a subset of the data
Fast extraction of the desired resolution
Check-list
Avoid having to open a large number of files per
request
Avoid parsing of complex structures and slow
compressions
Get to know your bottlenecks
CPU vs Disk Access Time vs Memory
Experiment with
Format, compression, different color models, tile size,
overviews, GeoServer configuration
FOSS4G-EU 2015, Como
14th July 2015
22. Peculiar Formats
PNG/JPEG direct serving (as data sources)
Bad formats (especially in Java)
No tiling (or rarely supported)
Chew a lot of memory and CPU for decompression
Mitigate with external overviews
Any input ASCII format (GML grid, ASCII grid)
JPEG2000
Extensible and rich, not (always) fast, can be difficult
to tune for performance (might require specific
encoding options)
MrSID (can work, needs tuning)
ECW (licensing issues)
FOSS4G-EU 2015, Como
14th July 2015
23. GeoTiff for the win
To remember: GeoTiff is a swiss knife
But you don’t want to cut a tree with it!
Tremendously flexible, good for for most (not all) use
cases
BigTiff pushes the GeoTiff limits farther
Use GeoTiff when
Overviews and Tiling stay within 4GB
No additional dimensions
Consider BigTiff for very large file (> 4 GB)
Support for tiling
Support for Overviews
Can be inefficient with very large files + small tiling
FOSS4G-EU 2015, Como
14th July 2015
24. GeoTiff preparation
(Optional) Use gdal_warp to transform the data in the most
used output reference system (mind, any reprojection
ruins the data a bit)
Use gdal_translate to add inner tiling and fix eventual
issues with coordinate reference system
Add compression options if you disks are small/slow/not
local (consider JPEG compression with YCBCR color
interpretation for photos, LZW/Deflate for scientific data)
Use gdaladdo to add internal overviews (remember to
replicate compression here)
FOSS4G-EU 2015, Como
14th July 2015
25. Possible structures
Single GeoTiff
with internal tiling
and overviews
(GeoTiff < 2GB,
BigTiff < 20-50GB)
Mosaic of GeoTiff, each one
with internal tiling and overviews
(< 500GB, not too many files)
Image pyramid,
each level has
lower resolution
than the previous,
each level has tiles
with inner tiling but
no overviews
(also possible to mix,
less levels and use
internal overviews)
> 500GB
FOSS4G-EU 2015, Como
14th July 2015
26. Choosing Formats and Layouts
Use ImageMosaic when:
A single file gets too big (inefficient seeks, too much metadata
to read, etc..)
Multiple Dimensions (time, elevation, others..)
Avoid mosaics made of many very small files
Single granules can be large
Use Tiling + Overviews + Compression on granules
Use ImagePyramid when:
Tremendously large dataset
Too many files / too large files
Need to serve at all scales
Especially low resolution
For single granules (< 2Gb) GeoTiff is generally a good fit
FOSS4G-EU 2015, Como
14th July 2015
27. Proper Mosaic Preparation
Optimize files as if you were serving them individually
Keep a balance between number and dimensions of
granules
If memory is scarce:
USE_JAI_IMAGREAD to true
USE_MULTITHREADING to false*
Otherwise
USE_JAI_IMAGREAD to false
ALLOW_MULTITHREADING to true
(Load data from different granules in
parallel)
More Info
http://geoserver.geo-
solutions.it/edu/en/raster_data/mosai
c_pyramid.html
FOSS4G-EU 2015, Como
14th July 2015
28. Proper Pyramid Preparation
Use gdal_retile for creating the pyramid
Prepare the list of tiles to be retiled
Create the pyramid with GDAL retile (grab a coffee!)
Chunks should not be too small (here 2048x2048), if you go larger, use
also inner tiling
If the input dataset is huge use the useDirForEachRow option
Too many files in a dir is bad practice
Make sure the number of level is consistent with usage
Too few bad performance at high scale
GeoServer config same as mosaic
More Info
http://geoserver.geo-
solutions.it/edu/en/raster_data/mosaic_pyramid.html
FOSS4G-EU 2015, Como
14th July 2015
29. Proper GeoServer
Coverage Config Opts
Make sure native JAI is installed
Install the TurboJPEG extension
Enable JAI Mosaicking native
acceleration
Give JAI enough memory
Don’t raise JAI memory Threshold too
high
Rule of thumb: use 2 X #Core Tile
Threads (check next slide)
Play with tile Recycling against your
workflows (might help, might not)
FOSS4G-EU 2015, Como
14th July 2015
30. Proper GeoServer
Coverage Config Opts
Multithreaded Granule Loading
Allows to fine tuning multithreading
for ImageMosaic
Orthogonal to JAI Tile Threads
Rule of Thumb: use 2 X #Core Tile
Threads
Perform testing to fine tune
depending on layer configuration as
well as on typical requests
ImageIO Cache threshold
decide when we switch to disk
cache (very large WCS requests)
FOSS4G-EU 2015, Como
14th July 2015
31. Exercise
Let's check the effect of optimization in GeoServer
Follow the instructions on the links below
http://geoserver.geo-solutions.it/educational/en/adv_gsconfig/jmeter/jmeter_mosaic.html
This test uses JMeter for testing GeoServer performances
before and after the optimization of a Mosaic Layer.
FOSS4G-EU 2015, Como
14th July 2015
32. Additional Material & Exercises
Using ImageMosaic with Footprint
http://geoserver.geo-
solutions.it/edu/en/raster_data/imagemosaic_footprint.html
Advanced Processing With GDAL Utilities
http://geoserver.geo-
solutions.it/edu/en/raster_data/advanced_gdal/index.html
FOSS4G-EU 2015, Como
14th July 2015
34. Vector data checklist
What do we want from vector data:
Binary data
No complex parsing of data structures
Fast extraction of a geographic subset
Fast filtering on the most commonly used
attributes
FOSS4G-EU 2015, Como
14th July 2015
35. Choosing a format
Slow formats
WFS
GML
DXF
Good formats, local and
index-able
Shapefile
Directory of shapefiles
SDE
Spatial databases:
PostGIS, Oracle
Spatial, DB2, MySQL*,
SQL server*
Swiss Knife SQL Views
FOSS4G-EU 2015, Como
14th July 2015
36. DBMS Checklist
Rich support for complex native filters
Use connection pooling
Validate connections (with proper pooling)
Table Clustering
Spatial Indexing
Spatial Indexing
Spatial Indexing
Alphanumeric Indexing
Alphanumeric Indexing
Alphanumeric Indexing
Did we mention indexes?
FOSS4G-EU 2015, Como
14th July 2015
37. Shapefile preparation
Remove .qix file if present
If there are large DBF attributes that are not in use, get rid
of them using ogr2ogr, e.g.:
ogr2ogr -select FULLNAME,MTFCC arealm.shp
tl_2010_08013_arealm.shp
If on Linux, enable memory mapping, faster, more scalable
(but will kill Windows):
FOSS4G-EU 2015, Como
14th July 2015
38. Shapefile filtering
Stuck with shapefiles and have scale dependent rules like
the following?
Show highways first
Show all streets when zoomed in
Use ogr2ogr to build two shapefiles, one with just the
highways, one with everything, and build two layers, e.g.:
ogr2ogr -sql "SELECT * FROM
tl_2010_08013_roads WHERE MTFCC in ('S1100',
'S1200')" primaryRoads.shp
tl_2010_08013_roads.shp
Or hire us to develop non-spatial indexing for shapefile!
FOSS4G-EU 2015, Como
14th July 2015
39. PostGIS specific hints
PostgreSQL out of the box configured for very small
hardware:
http://wiki.postgresql.org/wiki/Performance_Optimization
Make sure to run ANALYZE after data imports (updates
optimizer stats)
As usual, avoid large joins in SQL views, consider
materialized views
If the dataset is massive, CLUSTER on the spatial index:
http://postgis.refractions.net/documentation/manual-
1.3/ch05.html
FOSS4G-EU 2015, Como
14th July 2015
40. PostGIS specific hints
Careful with prepared statements (bad performances)
USE CASE: the layer’s style allows to display the whole
layer in a single shot (no scale dependencies) prepared
statements will slow down execution
EXPLANATION: Postgis will choose to use the spatial
index in all cases, this makes retrieving the full data set 2-4
times slower than when using a sequential scan
COUNTERMEASURE: Not using prepared statement allows
postgis to figure out a suitable plan based on the request
bbox instead (assuming someone run "vacuum analyze"
on the database to update the index statistics, and of
course, provided there is a spatial index to start with)
FOSS4G-EU 2015, Como
14th July 2015
41. SQL Server specific hints
Switch to PostgreSQL/PostGIS!
FOSS4G-EU 2015, Como
14th July 2015
43. SQL Views Support
Vector Data Swiss Knife
http://geoserver.geo-
solutions.it/edu/en/adding_data/add_sqllayers.html
FOSS4G-EU 2015, Como
14th July 2015
44. Exercise
Let's compare Shapefile and PostGIS in GeoServer
Follow the instructions on the links below
http://geoserver.geo-solutions.it/educational/en/adv_gsconfig/jmeter/jmeter_vector.html
This test uses Jmeter for comparing GeoServer
performances using a Shapefile or an optimized PostGIS
database containing the same data
FOSS4G-EU 2015, Como
14th July 2015
46. Use scale dependencies
Never show too much data
the map should be readable, not a graphic blob. Rule of thumb:
1000 features max in the display, have labels show up when
zoomed in
Show details as you zoom in
Eagerly add MinScaleDenominator to your SLD rules
Add more expensive rendering when there are less
features
Key to get both a good looking and fast map
FOSS4G-EU 2015, Como
14th July 2015
48. Labeling
Labeling conflict resolution is expensive, limit to the most
inner zooms
Halo is important for readability, but adds significant
overhead
Careful with maxDisplacement, makes for various label
location attempts
FOSS4G-EU 2015, Como
14th July 2015
49. FeatureTypeStyle
GeoServer uses SLD FeatureTypeStyle objects as Z layers
for painting
Each one allocates its own rendering surface (which can
use a lot of memory), use as few as possible
FOSS4G-EU 2015, Como
14th July 2015
50. Use translucency sparingly
Translucent display is expensive, use it sparingly
e.g. translucent fill <CssParameter name="fill-opacity">0.5</CssParameter>
FOSS4G-EU 2015, Como
14th July 2015
51. Exercise
Let's compare bad styles with properly setup ones
Follow the instructions on the links below
http://geoserver.geo-solutions.it/educational/en/adv_gsconfig/jmeter/jmeter_styles.html
This test uses JMeter to compare a style without scale
dependencies, showing too much data and too many
labels, with a one with proper scale dependencies and
providing a better looking output at the same output
FOSS4G-EU 2015, Como
14th July 2015
53. Tile caching with GeoWebCache
Tile oriented maps, fixed zoom levels and fixed grid
Useful for stable layers, backgrounds
Protocols: WMTS, TMS, WMS-C, Google Maps/Earth, VE
Speedup compared to dynamic WMS: 10 to 100 times,
assuming tiles are already cached (whole layer pre-
seeded)
Suitable for:
Mostly static layer
No/few dynamic parameters (CQL filters, SLD params,
SQL query params, time/elevation, format options)
FOSS4G-EU 2015, Como
14th July 2015
54. Embedded GWC advantage
No double encoding when using meta-tiling, faster seeding
FOSS4G-EU 2015, Como
14th July 2015
55. Space considerations
Seeding Colorado, assuming 8 cores, one layer, 0.1 sec
756x756 metatile, 15KB for each tile
Do yours: http://tinyurl.com/3apkpss
Not enough disk space? Set a disk quota
Zoom
level
Tile count Size (MB)
Time to seed
(hours)
Time to seed
(days)
13 58,377 1 0 0
14 232,870 4 0 0
15 929,475 14 0 0
16 3,713,893 57 1 0
17 14,855,572 227 6 0
18 59,396,070 906 23 1
19 237,584,280 3,625 92 4
20 950,273,037 14,500 367 15
FOSS4G-EU 2015, Como
14th July 2015
56. DiskQuota
Online Material
http://geoserver.geo-
solutions.it/edu/en/caching_data/diskquotas.html#disk-quota-
configuration
FOSS4G-EU 2015, Como
14th July 2015
57. More Tweaks
REST Interface Automate/Script management
Truncate
Remove Cached tiles
Seed
Pre-generate cache
Reseed
Regenerate tiles (due to data update, for instance)
Every seed/truncate operation can be filtered by:
Bounding box / Zoom limits
/ Format / GridSet
Parameters (style, time, other dimensions, cql_filter…)
Thread number
FOSS4G-EU 2015, Como
14th July 2015
58. More Tweaks
REST Seed example
FOSS4G-EU 2015, Como
14th July 2015
curl -u admin:password -H 'Content-type: text/xml' -H 'Accept: text/xml' -XPOST -d '
<seedRequest>
<name>topp:states</name>
<type>seed</type>
<gridSetId>EPSG:4326</gridSetId>
<bounds>
<coords>
<double>-100</double><double>-
80</double><double>100</double><double>80</double>
</coords>
</bounds>
<zoomStart>0</zoomStart><zoomStop>8</zoomStop>
<format>image/png8</format>
<threadCount>04</threadCount>
<parameters>
<entry>
<string>CQL_FILTER</string>
<string>TOTPOP BETWEEN 0 AND 10000</string>
</entry>
</parameters>
</seedRequest>
' http://localhost:8080/geoserver/gwc/rest/seed/topp:states.xml
59. More Tweaks
Online Resources for GWC REST API
Documentation
http://geowebcache.org/docs/current/rest/seed.html
http://docs.geoserver.org/stable/en/user/geowebcache/rest/seed
.html
Bash script for seed/reseed/truncate/mass truncate operations
https://github.com/geosolutions-
it/scripts/blob/master/geowebcache/gwc.sh
Sample script for clean cache in geoserver cluster
https://github.com/geosolutions-
it/scripts/blob/master/geowebcache/cleancache.sh
FOSS4G-EU 2015, Como
14th July 2015
60. More Tweaks
Clustering Single Shared Cache
Large, shared disk with fast R/W access
Perfect for bkg layers
Problematic set up in public cloud
Clustering Multiple Indipendent Caches
Exploit local, small, instance-based caches
Good for short lived caches
Duplication hit rsynch can help
Real-World Use Case
Dedicated Instances with shared cache for Bkg Layers
Indipendent Caches for other layers
FOSS4G-EU 2015, Como
14th July 2015
61. More Tweaks
Client-side caching of tiles
Does not work with browsers in private mode
<expireClientsList>
<expirationRule minZoom="0" expiration="7200" />
<expirationRule minZoom="10" expiration="600" />
</expireClientsList>
FOSS4G-EU 2015, Como
14th July 2015
62. More Tweaks
Use the right formats
JPEG for background data (e.g. ortos)
PNG8 + precomputed palette for background
data (e.g. ortos)
PNG8 full for overlays with transparency
The format impacts also the disk space needed!
(as well as the generation time)
Check this blog post
FOSS4G-EU 2015, Como
14th July 2015
63. Exercise
Let's compare GeoServer WMS with GeoWebCache
fullWMS.
Follow the instructions on the links below
http://geoserver.geo-solutions.it/educational/en/adv_gsconfig/jmeter/jmeter_gwc.html
This test uses JMeter for comparing GeoServer WMS
performances against those of GeoWebCache fullWMS
Mind, this is not the same as comparing WMS with pure
tile caching, GWC has to read the tiles from disk,
decompress, assemble the output image, and compress it
again in PNG (some speedup still, but not 10 times)
FOSS4G-EU 2015, Como
14th July 2015
65. Resource Limits
Limit the amount of resources dedicated to an individual
request
Improve fairness between requests, by preventing
individual requests from hijacking the server and/or
running for a very long time
EXTREMELY IMPORTANT in production environment
WHEN TO TWEAK THEM?
Frequent OOM Errors despite plenty of RAM
Requests that keep running for a long time (e.g. CPU
usage peaks even if no requests are being sent)
DB Connection being killed by the DBMS while in
usage (ok, you might also need to talk to the DBA..)
FOSS4G-EU 2015, Como
14th July 2015
66. WMS request limits
Max memory per request: avoid large requests, allows to
size the server memory (max concurrent request * max
memory)
Max time per request: avoid requests taking too much time
(e.g., using a custom style provided with dynamic SLD in
the request)
Max errors: best effort renderer, but handling errors takes
time
FOSS4G-EU 2015, Como
14th July 2015
67. WFS request limits
Max feature returned, configured as a global limit
Return feature bbox: reduce amount of generated GML
Per layer max feature count
FOSS4G-EU 2015, Como
14th July 2015
69. Exercise
Let's show how resource limits can be used to avoid
issues with slow requests
Follow the instructions on the links below
http://geoserver.geo-solutions.it/educational/en/adv_gsconfig/jmeter/jmeter_wmslimits.html
This test artificially limits the database resources to
quickly generate a starvation situation in which the limits
kick-in
FOSS4G-EU 2015, Como
14th July 2015
70. Control flow
Control how many requests are executed in parallel, queue
others:
Increase throughput
Control memory usage
Enforce fairness
More info
http://docs.geoserver.org/latest/en/user/community/controlflow/i
ndex.html
FOSS4G-EU 2015, Como
14th July 2015
72. Resource Limits
They need to be tweaked together with Control- Flow
Limiting individual requests Resource Limits
Limiting amount of parallel request Control Flow
When time is involved make sure you keep into account all
pieces of the response chain
E.G. Limited rendering time for WMS on data coming
from WMS, items to take into account are
LifeTime of DB Connection (usually long)
WaitTime for a new connection (we don’t want to
queue requests at the connection pool when they
area already eating memory!)
FOSS4G-EU 2015, Como
14th July 2015
73. Connection Pooling Tricks
Connection pool size should be proportional to the number of
concurrent requests you want to serve (obvious no?)
Activate connection validation
Mind networking tools that might cut connections sitting idle
(yes, your server is not always busy), they might cut the
connection in “bad” ways (10 minutes timeout before the pool
realizes the TCP connection attempt gives up)
Read more at
http://geoserver.geo-
solutions.it/edu/en/adv_gsconfig/db_pooling.html
https://docs.google.com/document/d/1O02PeDRYKt2xLW
G21k6BmcaRPzVRvXb4SQcrcZf4bHQ/edit?usp=sharing
FOSS4G-EU 2015, Como
14th July 2015
74. Exercise
Let's show how control-flow works in GeoServer
Follow the instructions on the links below
http://geoserver.geo-
solutions.it/educational/en/adv_gsconfig/jmeter/jmeter_controlflow.html
This test uses JMeter for testing GeoServer performances
before and after configuring the control-flow plugin.
FOSS4G-EU 2015, Como
14th July 2015
76. Premise
The options discussed here are not going to help visibly if
you did not prepare the data and the styles
They are finishing touches that can get performance up
once the major data bottlenecks have been dealt with
Check “Running in production” instructions here
FOSS4G-EU 2015, Como
14th July 2015
77. JVM settings
--server: enables the server JIT compiler
--Xms2048m -Xmx2048m: sets the JVM use two gigabytes
of memory
--XX:+UseParallelOldGC -XX:+UserParallelGC: enables
multi-threaded garbage collections, useful if you have
more than two cores
--XX:NewRatio=2: informs the JVM there will be a high
number of short lived objects
--XX:+AggressiveOpt: enable experimental optimizations
that will be defaults in future versions of the JVM
FOSS4G-EU 2015, Como
14th July 2015
78. Setup a local cluster
Oracle Java2D locks when drawing antialiased vectors
Limits scalability severely
Two options
Use OpenJDK, it’s slower at rendering but scales up
well
Use Apache mod_proxy_balance and setup a
GeoServer each 2/4 cores
mod_proxy_balance
GeoServer GeoServer GeoServer
FOSS4G-EU 2015, Como
14th July 2015
79. Clustering advantage
66%
FOSS4G 2010 vector benchmarks (roads/buildings/isolines
and so on, over the entire Spain)
GeoServer was benchmarked using Oracle JDK without
local clustering
FOSS4G-EU 2015, Como
14th July 2015
80. Marlin renderer
The OpenJDK Java2D renderer scales up, but it’s not
super-fast when the load is small (1 request at a time)
Marlin-renderer to the rescue:
https://github.com/bourgesl/marlin-renderer
Complex map, 10
parallel requests,
different zoom
levels have different
details showing up
FOSS4G-EU 2015, Como
14th July 2015
81. Upgrade!
Performance tends to go up version by version
Please do use a recent GeoServer version
FOSS4G 2010
vector
benchmark with
different
versions of
GeoServer
FOSS4G-EU 2015, Como
14th July 2015
82. Exercise
Let's show how Marlin renderer can speed up map
rendering under Windows, using GeoServer 2.5.x
Follow the instructions on the links below
http://geoserver.geo-solutions.it/educational/en/adv_gsconfig/jmeter/jmeter_marlin.html
This test uses JMeter for testing GeoServer performances
before and after setting up Marlin renderer
FOSS4G-EU 2015, Como
14th July 2015