GeoSolutions' presentation for the PTA Interreg 2012 wrkshop in La Salle, Aosta (ITALY) about GeoServer, GeoNetwork and the status for INSPIRE Compliancy
Standing on the Shoulders of Open-Source Giants: The Serverless Realtime Lake...HostedbyConfluent
"Unlike just a few years ago, today the lakehouse architecture is an established data platform embraced by all major cloud data companies such as AWS, Azure, Google, Oracle, Microsoft, Snowflake and Databricks.
This session kicks off with a technical, no-nonsense introduction to the lakehouse concept, dives deep into the lakehouse architecture and recaps how a data lakehouse is built from the ground up with streaming as a first-class citizen.
Then we focus on serverless for streaming use cases. Serverless concepts are well-known from developers triggering hundreds of thousands of AWS Lambda functions at a negligible cost. However, the same concept becomes more interesting when looking at data platforms.
We have all heard about the principle ""It runs best on Powerpoint"", so I decided to skip slides here and bring a serverless demo instead:
A hands-on, fun, and interactive serverless streaming use case example where we ingest live events from hundreds of mobile devices (don't miss out - bring your phone and be part of it!!). Based on this use case I will critically explore how much of a modern lakehouse is serverless and how we implemented that at Databricks (spoiler alert: serverless is everywhere from data pipelines, workflows, optimized Spark APIs, to ML).
TL;DR benefits for the Data Practitioners:
-Recap the OSS foundation of the Lakehouse architecture and understand its appeal
- Understand the benefits of leveraging a lakehouse for streaming and what's there beyond Spark Structured Streaming.
- Meat of the talk: The Serverless Lakehouse. I give you the tech bits beyond the hype. How does a serverless lakehouse differ from other serverless offers?
- Live, hands-on, interactive demo to explore serverless data engineering data end-to-end. For each step we have a critical look and I explain what it means, e.g for you saving costs and removing operational overhead."
Jeremy Engle's slides from Redshift / Big Data meetup on July 13, 2017AWS Chicago
"Strategies for supporting near real time analytics, OLAP, and interactive data exploration" - Dr. Jeremy Engle, Engineering Manager Data Team at Jellyvision
Modernizing to a Cloud Data ArchitectureDatabricks
Organizations with on-premises Hadoop infrastructure are bogged down by system complexity, unscalable infrastructure, and the increasing burden on DevOps to manage legacy architectures. Costs and resource utilization continue to go up while innovation has flatlined. In this session, you will learn why, now more than ever, enterprises are looking for cloud alternatives to Hadoop and are migrating off of the architecture in large numbers. You will also learn how elastic compute models’ benefits help one customer scale their analytics and AI workloads and best practices from their experience on a successful migration of their data and workloads to the cloud.
LDM Slides: Data Modeling for XML and JSONDATAVERSITY
Data modeling has traditionally focused on relational database systems. But in the age of the internet, technologies such as XML and JSON have evolved to provide structure and definition to “data in motion”. Have data modeling technologies evolved to support these technologies? Can we use traditional approaches to model data in XML and JSON? Or are new tools and methodologies required? Join this webinar to discuss:
- XML & JSON vs. Relational Database Modeling
- Techniques & Tools for Data Modeling for XML
- Techniques & Tools for Data Modeling for JSON
- Use Cases & Opportunities for XML and JSON Data Modeling
An introduction to Neo4j and Graph Databases. Learn about the primary use cases for Graph Databases and explore the properties of Neo4j that make those use cases possible.
Want to see a high-level overview of the products in the Microsoft data platform portfolio in Azure? I’ll cover products in the categories of OLTP, OLAP, data warehouse, storage, data transport, data prep, data lake, IaaS, PaaS, SMP/MPP, NoSQL, Hadoop, open source, reporting, machine learning, and AI. It’s a lot to digest but I’ll categorize the products and discuss their use cases to help you narrow down the best products for the solution you want to build.
Standing on the Shoulders of Open-Source Giants: The Serverless Realtime Lake...HostedbyConfluent
"Unlike just a few years ago, today the lakehouse architecture is an established data platform embraced by all major cloud data companies such as AWS, Azure, Google, Oracle, Microsoft, Snowflake and Databricks.
This session kicks off with a technical, no-nonsense introduction to the lakehouse concept, dives deep into the lakehouse architecture and recaps how a data lakehouse is built from the ground up with streaming as a first-class citizen.
Then we focus on serverless for streaming use cases. Serverless concepts are well-known from developers triggering hundreds of thousands of AWS Lambda functions at a negligible cost. However, the same concept becomes more interesting when looking at data platforms.
We have all heard about the principle ""It runs best on Powerpoint"", so I decided to skip slides here and bring a serverless demo instead:
A hands-on, fun, and interactive serverless streaming use case example where we ingest live events from hundreds of mobile devices (don't miss out - bring your phone and be part of it!!). Based on this use case I will critically explore how much of a modern lakehouse is serverless and how we implemented that at Databricks (spoiler alert: serverless is everywhere from data pipelines, workflows, optimized Spark APIs, to ML).
TL;DR benefits for the Data Practitioners:
-Recap the OSS foundation of the Lakehouse architecture and understand its appeal
- Understand the benefits of leveraging a lakehouse for streaming and what's there beyond Spark Structured Streaming.
- Meat of the talk: The Serverless Lakehouse. I give you the tech bits beyond the hype. How does a serverless lakehouse differ from other serverless offers?
- Live, hands-on, interactive demo to explore serverless data engineering data end-to-end. For each step we have a critical look and I explain what it means, e.g for you saving costs and removing operational overhead."
Jeremy Engle's slides from Redshift / Big Data meetup on July 13, 2017AWS Chicago
"Strategies for supporting near real time analytics, OLAP, and interactive data exploration" - Dr. Jeremy Engle, Engineering Manager Data Team at Jellyvision
Modernizing to a Cloud Data ArchitectureDatabricks
Organizations with on-premises Hadoop infrastructure are bogged down by system complexity, unscalable infrastructure, and the increasing burden on DevOps to manage legacy architectures. Costs and resource utilization continue to go up while innovation has flatlined. In this session, you will learn why, now more than ever, enterprises are looking for cloud alternatives to Hadoop and are migrating off of the architecture in large numbers. You will also learn how elastic compute models’ benefits help one customer scale their analytics and AI workloads and best practices from their experience on a successful migration of their data and workloads to the cloud.
LDM Slides: Data Modeling for XML and JSONDATAVERSITY
Data modeling has traditionally focused on relational database systems. But in the age of the internet, technologies such as XML and JSON have evolved to provide structure and definition to “data in motion”. Have data modeling technologies evolved to support these technologies? Can we use traditional approaches to model data in XML and JSON? Or are new tools and methodologies required? Join this webinar to discuss:
- XML & JSON vs. Relational Database Modeling
- Techniques & Tools for Data Modeling for XML
- Techniques & Tools for Data Modeling for JSON
- Use Cases & Opportunities for XML and JSON Data Modeling
An introduction to Neo4j and Graph Databases. Learn about the primary use cases for Graph Databases and explore the properties of Neo4j that make those use cases possible.
Want to see a high-level overview of the products in the Microsoft data platform portfolio in Azure? I’ll cover products in the categories of OLTP, OLAP, data warehouse, storage, data transport, data prep, data lake, IaaS, PaaS, SMP/MPP, NoSQL, Hadoop, open source, reporting, machine learning, and AI. It’s a lot to digest but I’ll categorize the products and discuss their use cases to help you narrow down the best products for the solution you want to build.
Organizations have been collecting, storing, and accessing data from the beginning of computerization. Insights gained from analyzing the data enable them to identify new opportunities, improve core processes, enable continuous learning and differentiation, remain competitive, and thrive in an increasingly challenging business environment.
The well-established data architecture, consisting of a data warehouse, fed from multiple operational data stores, and fronted by BI tools, has served most organizations well. However, over the last two decades, with the explosion of internet-scale data, and the advent of new approaches to data and computational processing, this tried-and-true data architecture has come under strain, and has created both challenges and opportunities for organizations.
In this green paper, we will discuss modern approaches to data architecture that have evolved to address these challenges and provide a framework for companies to build a data architecture and better adapt to increasing demands of the modern business environment. This discussion of data architecture will be tied to the Data Maturity Journey introduced in EQengineered’s June 2021 green paper on Data Modernization.
Describes what Enterprise Data Architecture in a Software Development Organization should cover and does that by listing over 200 data architecture related deliverables an Enterprise Data Architect should remember to evangelize.
Straight Talk to Demystify Data LineageDATAVERSITY
Are you sure you trust the data you just used for that $10 million decision? To trust data authenticity we must first understand its lineage. However, the term "Data Lineage" itself is ambiguous since it is used in different contexts. "Business Lineage" links metadata constructs to specific terms in a business glossary. This approach is used by numerous Data Governance solutions. This approach alone comes up short, since it doesn't trace the real flow of information through an organization. "Technical Lineage" traces data's journey through different systems and data stores, providing an audit trail of the changes along the way. True "Data Lineage" combines both aspects, providing context to fully understand the data life cycle. Every step in data's journey is a potential source for introduction of error that could compromise Data Quality, and hence, business decisions. In this session, Ron Huizenga offers a comprehensive discussion of data lineage and associated Data Quality remediation approaches that are essential to build a foundation for Data Governance.
I gave this presentation at the Advanced Architecture Conference, Bill Inmon, 2011 in Evergreen, Colorado. This presentation covers a new breed of data warehousing called Operational Data Warehousing. These are the next steps in business intelligence towards self-service BI and enabling users to do more with their enterprise data warehouse solution. Specifically, it talks about how the Data Vault model fits in to this picture.
If you would like to use the slides, please e-mail me first, I'd be happy to discuss it with you.
Independent of the source of data, the integration of event streams into an Enterprise Architecture gets more and more important in the world of sensors, social media streams and Internet of Things. Events have to be accepted quickly and reliably, they have to be distributed and analysed, often with many consumers or systems interested in all or part of the events. Storing such huge event streams into HDFS or a NoSQL datastore is feasible and not such a challenge anymore. But if you want to be able to react fast, with minimal latency, you can not afford to first store the data and doing the analysis/analytics later. You have to be able to include part of your analytics right after you consume the event streams. Products for doing event processing, such as Oracle Event Processing or Esper, are avaialble for quite a long time and also used to be called Complex Event Processing (CEP). In the last 3 years, another family of products appeared, mostly out of the Big Data Technology space, called Stream Processing or Streaming Analytics. These are mostly open source products/frameworks such as Apache Storm, Spark Streaming, Apache Samza as well as supporting infrastructures such as Apache Kafka. In this talk I will present the theoretical foundations for Event and Stream Processing and present what differences you might find between the more traditional CEP and the more modern Stream Processing solutions and show that a combination of both will bring the most value.
Delta Lake delivers reliability, security and performance to data lakes. Join this session to learn how customers have achieved 48x faster data processing, leading to 50% faster time to insight after implementing Delta Lake. You’ll also learn how Delta Lake provides the perfect foundation for a cost-effective, highly scalable lakehouse architecture.
Overcoming the Challenges of your Master Data Management JourneyJean-Michel Franco
This Presentaion runs you through all the key steps of an MDM initiative. It considers and showcase the key milestones and building blocks that you will have to roll-out to make your MDM
journey
-> Please contact Talend for a dedicated interactive sessions with a storyboard by customer domain
Semantic Web technologies (such as RDF and SPARQL) excel at bringing together diverse data in a world of independent data publishers and consumers. Common ontologies help to arrive at a shared understanding of the intended meaning of data.
However, they don’t address one critically important issue: What does it mean for data to be complete and/or valid? Semantic knowledge graphs without a shared notion of completeness and validity quickly turn into a Big Ball of Data Mud.
The Shapes Constraint Language (SHACL), an upcoming W3C standard, promises to help solve this problem. By keeping semantics separate from validity, SHACL makes it possible to resolve a slew of data quality and data exchange issues.
Presented at the Lotico Berlin Semantic Web Meetup.
With the world’s supply chain system in crisis, it’s clear that better solutions are needed. Digital twins built on knowledge graph technology allow you to achieve an end-to-end view of the process, supporting real-time monitoring of critical assets.
Next generation intelligent data lakes, powered by GraphQL & AWS AppSync - MA...Amazon Web Services
GraphQL is a query language for APIs and a runtime to fulfill these queries, allowing applications to easily connect and access data stored on any type of database technology or API. AWS AppSync provides a powerful and flexible serverless GraphQL API that securely accesses, manipulates, and combines data from multiple sources at any scale, enabling you to build any kind of application on a range of data sources independently of the underlying database technology. In this session, we discuss different use cases where AWS AppSync and GraphQL power next-generation applications. Special guest, Candid Partners, shares how it uses AWS AppSync in its Data Fabric solution to simplify large-scale data management using a GraphQL API to interact with data lakes.
Making Data Timelier and More Reliable with Lakehouse TechnologyMatei Zaharia
Enterprise data architectures usually contain many systems—data lakes, message queues, and data warehouses—that data must pass through before it can be analyzed. Each transfer step between systems adds a delay and a potential source of errors. What if we could remove all these steps? In recent years, cloud storage and new open source systems have enabled a radically new architecture: the lakehouse, an ACID transactional layer over cloud storage that can provide streaming, management features, indexing, and high-performance access similar to a data warehouse. Thousands of organizations including the largest Internet companies are now using lakehouses to replace separate data lake, warehouse and streaming systems and deliver high-quality data faster internally. I’ll discuss the key trends and recent advances in this area based on Delta Lake, the most widely used open source lakehouse platform, which was developed at Databricks.
FAIR Workflows and Research Objects get a Workout Carole Goble
So, you want to build a pan-national digital space for bioscience data and methods? That works with a bunch of pre-existing data repositories and processing platforms? So you can share FAIR workflows and move them between services? Package them up with data and other stuff (or just package up data for that matter)? How? WorkflowHub (https://workflowhub.eu) and RO-Crate Research Objects (https://www.researchobject.org/ro-crate) that’s how! A step towards FAIR Digital Objects gets a workout.
Presented at DataVerse Community Meeting 2021
Organizations have been collecting, storing, and accessing data from the beginning of computerization. Insights gained from analyzing the data enable them to identify new opportunities, improve core processes, enable continuous learning and differentiation, remain competitive, and thrive in an increasingly challenging business environment.
The well-established data architecture, consisting of a data warehouse, fed from multiple operational data stores, and fronted by BI tools, has served most organizations well. However, over the last two decades, with the explosion of internet-scale data, and the advent of new approaches to data and computational processing, this tried-and-true data architecture has come under strain, and has created both challenges and opportunities for organizations.
In this green paper, we will discuss modern approaches to data architecture that have evolved to address these challenges and provide a framework for companies to build a data architecture and better adapt to increasing demands of the modern business environment. This discussion of data architecture will be tied to the Data Maturity Journey introduced in EQengineered’s June 2021 green paper on Data Modernization.
Describes what Enterprise Data Architecture in a Software Development Organization should cover and does that by listing over 200 data architecture related deliverables an Enterprise Data Architect should remember to evangelize.
Straight Talk to Demystify Data LineageDATAVERSITY
Are you sure you trust the data you just used for that $10 million decision? To trust data authenticity we must first understand its lineage. However, the term "Data Lineage" itself is ambiguous since it is used in different contexts. "Business Lineage" links metadata constructs to specific terms in a business glossary. This approach is used by numerous Data Governance solutions. This approach alone comes up short, since it doesn't trace the real flow of information through an organization. "Technical Lineage" traces data's journey through different systems and data stores, providing an audit trail of the changes along the way. True "Data Lineage" combines both aspects, providing context to fully understand the data life cycle. Every step in data's journey is a potential source for introduction of error that could compromise Data Quality, and hence, business decisions. In this session, Ron Huizenga offers a comprehensive discussion of data lineage and associated Data Quality remediation approaches that are essential to build a foundation for Data Governance.
I gave this presentation at the Advanced Architecture Conference, Bill Inmon, 2011 in Evergreen, Colorado. This presentation covers a new breed of data warehousing called Operational Data Warehousing. These are the next steps in business intelligence towards self-service BI and enabling users to do more with their enterprise data warehouse solution. Specifically, it talks about how the Data Vault model fits in to this picture.
If you would like to use the slides, please e-mail me first, I'd be happy to discuss it with you.
Independent of the source of data, the integration of event streams into an Enterprise Architecture gets more and more important in the world of sensors, social media streams and Internet of Things. Events have to be accepted quickly and reliably, they have to be distributed and analysed, often with many consumers or systems interested in all or part of the events. Storing such huge event streams into HDFS or a NoSQL datastore is feasible and not such a challenge anymore. But if you want to be able to react fast, with minimal latency, you can not afford to first store the data and doing the analysis/analytics later. You have to be able to include part of your analytics right after you consume the event streams. Products for doing event processing, such as Oracle Event Processing or Esper, are avaialble for quite a long time and also used to be called Complex Event Processing (CEP). In the last 3 years, another family of products appeared, mostly out of the Big Data Technology space, called Stream Processing or Streaming Analytics. These are mostly open source products/frameworks such as Apache Storm, Spark Streaming, Apache Samza as well as supporting infrastructures such as Apache Kafka. In this talk I will present the theoretical foundations for Event and Stream Processing and present what differences you might find between the more traditional CEP and the more modern Stream Processing solutions and show that a combination of both will bring the most value.
Delta Lake delivers reliability, security and performance to data lakes. Join this session to learn how customers have achieved 48x faster data processing, leading to 50% faster time to insight after implementing Delta Lake. You’ll also learn how Delta Lake provides the perfect foundation for a cost-effective, highly scalable lakehouse architecture.
Overcoming the Challenges of your Master Data Management JourneyJean-Michel Franco
This Presentaion runs you through all the key steps of an MDM initiative. It considers and showcase the key milestones and building blocks that you will have to roll-out to make your MDM
journey
-> Please contact Talend for a dedicated interactive sessions with a storyboard by customer domain
Semantic Web technologies (such as RDF and SPARQL) excel at bringing together diverse data in a world of independent data publishers and consumers. Common ontologies help to arrive at a shared understanding of the intended meaning of data.
However, they don’t address one critically important issue: What does it mean for data to be complete and/or valid? Semantic knowledge graphs without a shared notion of completeness and validity quickly turn into a Big Ball of Data Mud.
The Shapes Constraint Language (SHACL), an upcoming W3C standard, promises to help solve this problem. By keeping semantics separate from validity, SHACL makes it possible to resolve a slew of data quality and data exchange issues.
Presented at the Lotico Berlin Semantic Web Meetup.
With the world’s supply chain system in crisis, it’s clear that better solutions are needed. Digital twins built on knowledge graph technology allow you to achieve an end-to-end view of the process, supporting real-time monitoring of critical assets.
Next generation intelligent data lakes, powered by GraphQL & AWS AppSync - MA...Amazon Web Services
GraphQL is a query language for APIs and a runtime to fulfill these queries, allowing applications to easily connect and access data stored on any type of database technology or API. AWS AppSync provides a powerful and flexible serverless GraphQL API that securely accesses, manipulates, and combines data from multiple sources at any scale, enabling you to build any kind of application on a range of data sources independently of the underlying database technology. In this session, we discuss different use cases where AWS AppSync and GraphQL power next-generation applications. Special guest, Candid Partners, shares how it uses AWS AppSync in its Data Fabric solution to simplify large-scale data management using a GraphQL API to interact with data lakes.
Making Data Timelier and More Reliable with Lakehouse TechnologyMatei Zaharia
Enterprise data architectures usually contain many systems—data lakes, message queues, and data warehouses—that data must pass through before it can be analyzed. Each transfer step between systems adds a delay and a potential source of errors. What if we could remove all these steps? In recent years, cloud storage and new open source systems have enabled a radically new architecture: the lakehouse, an ACID transactional layer over cloud storage that can provide streaming, management features, indexing, and high-performance access similar to a data warehouse. Thousands of organizations including the largest Internet companies are now using lakehouses to replace separate data lake, warehouse and streaming systems and deliver high-quality data faster internally. I’ll discuss the key trends and recent advances in this area based on Delta Lake, the most widely used open source lakehouse platform, which was developed at Databricks.
FAIR Workflows and Research Objects get a Workout Carole Goble
So, you want to build a pan-national digital space for bioscience data and methods? That works with a bunch of pre-existing data repositories and processing platforms? So you can share FAIR workflows and move them between services? Package them up with data and other stuff (or just package up data for that matter)? How? WorkflowHub (https://workflowhub.eu) and RO-Crate Research Objects (https://www.researchobject.org/ro-crate) that’s how! A step towards FAIR Digital Objects gets a workout.
Presented at DataVerse Community Meeting 2021
The following presentation "Building Interoperable SDIs with Open Source Products" was held by GeoSolutions' founder and managing director at GeoSpatial World Forum 2015, Lisbon.
Main topics:
- GeoSolutions' presentation
- GeoSolutions' expertise
- GeoSolutions' products (GeoServer, GeoNetwork, MapStore)
- GeoSolutions' main clients
MapStore 2, modern mashups with OL3, Leaflet and ReactGeoSolutions
MapStore 2 is an overhaul of the existing MapStore with the goal of creating a webmapping framework which is more lightweight but still modular and easy to work with. It can leverage both OpenLayers 3 or Leaflet as the mapping engine and uses ReactJS and Redux as the core JavaScript libraries. Moreover a 3D viewer based on CesiumJS is available.
MapStore 2 is both a framework and a standalone application. You can use it as a framework to develop your custom WebGis application composing MapStore ReactJS components and components from other libraries (like React Bootstrap), choosing the best mapping library for your purposes. You can also use the MapStore2 application directly, to create, save, and share in a simple and intuitive way maps and mashups created by selecting content from the server such as Google Maps, OpenStreetMap or WMS and WMTS.
The MapStore 2 application consists of two main components MapManager and GeoStore, respectively front-end and back-end. MapManager allows through a unique interface to create, modify, delete and search on maps definition as well as generate a univoque link to embed a map in an external website, share your own maps with the others. GeoStore implements a flexible Java Enterprise infrastructure to manage and search maps with proper management of authentication and authorization.
The presentation will give the audience an extensive overview of the MapStore 2 functionalities for the creation of mapping portals. Eventually, a range of GeoSolutions case studies of MapStore 2 will be presented.
Each month, join us as we highlight and discuss hot topics ranging from the future of higher education to wearable technology, best productivity hacks and secrets to hiring top talent. Upload your SlideShares, and share your expertise with the world!
Not sure what to share on SlideShare?
SlideShares that inform, inspire and educate attract the most views. Beyond that, ideas for what you can upload are limitless. We’ve selected a few popular examples to get your creative juices flowing.
GeoSolutions contributions to the CUSTOM ProjectGeoSolutions
Slides describing GeoSolutions contribution to the CUSTOM project, a cloud platform to support cultural heritage and tourism needs.
This presentation includes also a short introduction to the GeoServer platform.
Presentation about GeoServer helded by GeoSolutions technical lead Mauro Bartolomeoli at GeoBusiness 2015, London.
Main topics:
-Quick intro to GeoServer
-What’s new in the 2.6.x and 2.7.x series
-What’s cooking for the future
Presentations from IMGS at Local Government User Group session on 11/09/2012.
Includes presentations on Location Publisher updates, GeoMedia Smartclient, Leica Geosystems and ERDAS Imagine and Apollo
Raster Data In GeoServer And GeoTools: Achievements, Issues And Future Develo...GeoSolutions
The purpose of this presentation is to discuss the developments during last years in raster data support in GeoTools and GeoServer, and also to introduce and discuss future development directions.
GeoServer is the start of a great open source success story. This talk introduces the core GeoServer application and explores the ecosystem that has developed around this beloved OSGeo application.
This talks draws on the GeoServer ecosystem for use-cases and examples of how the application has been used successfully by a wide range of organizations.
Andrea Amie from GeoSolutions is on hand to share success stories highlighting GeoServer use in managing vulnerable ecosystems, agriculture information management, and marine data management.
Jody Garnett will look at how GeoServer enables Boundless products including Boundless Server and Boundless Server Enterprise.
We will look at GeoServer use at OSGeo with both GeoNetwork and GeoNode making use of the technology.
LocationTech is not ignored with the “big data” players in the form of GeoMesa and GeoWave bridging to cloud data sources of epic proportion
We use each use-case to highlights a capability of GeoServer providing an overview of the application drawn from practical examples.
Attend this talk for inspiration on what is possible with GeoServer and open source.
State of GeoServer provides an update on our community and reviews the new and noteworthy features for 2018. GeoServer is a web service for publishing your geospatial data. using industry standards for vector, raster and mapping.
We have an active community and a lot to cover for 2.12 and 2.13 release, as well what is cooking in September’s 2.14 release.
Each release provides exciting new features, this talk covers diverse improvements across GeoServer:
* OGC compliance work for WFS 2.0 and WMTS 1.0, WFS 3.0 support
* improvements for cloud deployments
* cascade WMTS services
* progress in NetCDF support
* getting ready for the Java 18.9 roadmap
* And much more…
Attend this talk for a cheerful update on what is happening with this popular OSGeo project. Whether you are an expert user, a developer, or simply curious what GeoServer can do for you.
Using GeoServer for spatio-temporal data management with examples for MetOc a...GeoSolutions
This presentation will provide detailed information on how to ingest and configure spatio-temporal data in GeoServer, to be served using OGC services, with examples from WMS and WCS services.
MapStore 2 is an Open Source webmapping framework which uses ReactJS, Redux, OpenLayers, Leaflet and Cesium.
It supports various OGC Protocols like CSW, WMS, WFS and WMTS and allows end users to create charts and dashboards thanks to its integration with GeoServer.
GeoSolutions has been involved into a number of projects, ranging from local administrations to global institutions, involving GeoNode deployments, customizations and enhancements. A gallery of projects and use cases will showcase the versatility and effectiveness of GeoNode, both as a standalone application and as a service component, for building secured geodata catalogs and web mapping services. Lastly, ongoing and future developments will be presented ranging from the upcoming integration with MapStore to the monitoring and analytics dashboard or the support for time series data.
This presentation has been prepared with the objective to give readers a quick introduction to the Open Source GeoNode platform and its functionalities for the creation of a Spatial Data Infrastructure completely based on open Source components.
Serving earth observation data with GeoServer: addressing real world requirem...GeoSolutions
Information on the latest developments in GeoServer for the support for Earth Observation data with support for the various OGC services and OpenSearch.
This presentation goes over the most important features of GeoServer in order to give the reader an intro about what is good and what is super-good about GeoServer!
The current version reflects the presentation given at FOSS4G 2017 in Boston.
State of GeoServer provides an update on our community and reviews the new and noteworthy features for the Project. The community keeps an aggressive six month release cycle with GeoServer 2.11 and 2.12 being released this year. Each releases bring together exciting new features. This year a lot of work has been done on startup times, large catalogs, REST configuration upgrades, styling languages, styling interface, security,just to name a few. We will also take a look at community research into satellite imagery search and delivery, multi-resolution raster support and more. Attend this talk for a cheerful update on what is happening with this popular OSGeo project. Whether you are an expert user, a developer, or simply curious what these projects can do for you, this talk is for you.
State of GeoServer provides an update on our community and reviews the new and noteworthy features for the Project. The community keeps an aggressive six month release cycle with GeoServer 2.8 and 2.9 being released this year.
Each releases bring together exciting new features. This year a lot of work has been done on the user interface, clustering, security and compatibility with the latest Java platform. We will also take a look at community research into vector tiles, multi-resolution raster support and more.
Attend this talk for a cheerful update on what is happening with this popular OSGeo project. Whether you are an expert user, a developer, or simply curious what these projects can do for you, this talk is for you.
Creating Stunning Maps in GeoServer: mastering SLD and CSS stylesGeoSolutions
Various software can style maps and generate a proper SLD document for OGC compliant WMS like GeoServer to use. However, in most occasions, the styling allowed by the graphical tools is pretty limited and not good enough to achieve good looking, readable and efficient cartographic output. For those that like to write their own styles CSS also represents a nice alternatives thanks to its compactness and expressiveness.
Several topics will be covered, providing examples in both SLD and CSS for each, including: mastering multi-scale styling, using GeoServer extensions to build common hatch patterns, line styling beyond the basics, such as cased lines, controlling symbols along a line and the way they repeat, leveraging TTF symbol fonts and SVGs to generate good looking point thematic maps, using the full power of GeoServer label lay-outing tools to build pleasant, informative maps on both point, polygon and line layers, including adding road plates around labels, leverage the labeling subsystem conflict resolution engine to avoid overlaps in stand alone point symbology, blending charts into a map, dynamically transform data during rendering to get more explicative maps without the need to pre-process a large amount of views.
The presentation aims to provide the attendees with enough information to master SLD/CSS documents and most of GeoServer extensions to generate appealing, informative, readable maps that can be quickly rendered on screen.
Serving earth observation data with GeoServer: addressing real world requirem...GeoSolutions
The presentation will cover GeoSolutions experience in setting up GeoServer based production systems providing access to earth observation products, with indications of technical challenges, solutions, and deployment suggestion. The presentations will cover topics such as setting up a single unified mosaic from all the available data sources, tailoring access to it to different users, determining the most appropriate stacking order, dealing with multiresolution, different coordinate systems, multiband data, SAR integration, searching for the most appropriate products using a mix of WFS, CSW and so on, serving imagery with high performance WMS and WMTS, performing small and large data extractions with WCS and WPS, closing up with deployment examples and suggestions.
Mastering Security with GeoServer and GeoFence - FOSS4G EU 2017GeoSolutions
The presentation will provide an introduction to GeoServer own authentication and authorization subsystems. We’ll cover the supported authentication protocols, such as from basic/digest authentication and CAS support, check through the various identity providers, such as local config files, database tables and LDAP servers, and how it’s possible to combine the various bits in a single comprehensive authentication tool, as well as providing examples of custom authentication plugins for GeoServer, integrating it in a home grown security architecture. We’ll then move on to authorization, describing the GeoServer pluggable authorization mechanism and comparing it with proxy based solution, and check the built in service and data security system, reviewing its benefits and limitations. Finally we’ll explore the advanced authentication provider, GeoFence, explore the levels on integration with GeoServer, from the simple and seamless direct integration to the more sophisticated external setup, and see how it can provide GeoServer with complex authorization rules over data and OGC services, taking into account the current user, OGC request and requested layers to enforce spatial filters and alphanumeric filters, attribute selection as well as cropping raster data to areas of interest.
GeoServer in Production: we do it, here is how!GeoSolutions
The presentation will describe how to setup a production system based on GeoServer from the points of view of performance, availability and security. The suggestions will start covering how a single node GeoServer should be prepared for internet usage, tuning logging, connection pools, security, data and JVM preparation, keeping disk, memory and CPU usage in check within the limits of the available resources. We’ll then move to tools used to monitor the production instances, ranging from probes to request auditing and watch-dogs. Finally the presentation will cover setting up a cluster of server and the strategies for keeping them in synch, from the traditional multi-tier setup (testing vs production) to the systems that need to keep an ever evolving catalog of layers constantly on-line and in synch.
Crunching Data In GeoServer: Mastering Rendering Transformations, WPS Process...GeoSolutions
This presentation will provide the attendee with an introduction to data processing in GeoServer by means of WPS, rendering transformations and SQL views, describing real applications and how these facilities were used in them.
We'll start with the basic WPS capabilities, showing how to build processing request based on existing processes and how to build new processes leveraging scripting languages, and introducing unique GeoServer integration features, showing how processing can seamlessly integrate directly in the GeoServer data sources and complement existing services.
We'll also discuss how to integrate on the fly processing in WMS requests, achieving high performance data displays without having to pre-process the data in advance, and allowing the caller to interactively choose processing parameters.
While the above shows how to make GeoServer perform the work, the processing abilities of spatial databases should not be forgotten, so we’ll show how certain classes of processing can be achieved directly in the database.
At the end the attendee will be able to easily issue WPS requests both for Vectors and Rasters to GeoServer through the WPS Demo Builder, enrich SLDs with on-the-fly rendering transformations and play with SQL views in order to create dynamic layers.
Advanced Security with GeoServer - FOSS4G 2015GeoSolutions
The presentation will provide an introduction to GeoServer own authentication and authorization subsystems. We’ll cover the supported authentication protocols, such as from basic/digest authentication and CAS support, check through the various identity providers, such as local config files, database tables and LDAP servers, and how it’s possible to combine the various bits in a single comprehensive authentication tool, as well as providing examples of custom authentication plugins for GeoServer, integrating it in a home grown security architecture.
We’ll then move on to authorization, describing the GeoServer pluggable authorization mechanism and comparing it with proxy based solution, and check the built in service and data security system, reviewing its benefits and limitations.
Finally we’ll explore the advanced authentication provider, GeoFence, explore the levels on integration with GeoSErver, from the simple and seamless direct integration to the more sophisticated external setup, and see how it can provide GeoServer with complex authorization rules over data and OGC services, taking into account the current user, OGC request and requested layers to enforce spatial filters and alphanumeric filters, attribute selection as well as cropping raster data to areas of interest.
Raster Data In GeoServer and GeoTools: Achievements, Issues And Future Develo...GeoSolutions
The purpose of this presentation is, on a side, to dissect the developments performed during last year as far as raster data support in GeoTools and GeoServer is concerned, while on the other side to introduce and discuss the future development directions.
Advancements and improvements for the management of multidimensional raster data (NetCDF, GRIB, HDF) and mosaic thereof will be introduced, as well as the available ways to manage sliding windows of data via the REST API and importer.
Extensive details will be provided on the latest updates for the management of multidimensional raster data used in the Remote Sensing and MetOc fields, including support for WCS EO and WMS EO, and some considerations on the WCS MetOc extensions.
The presentation will also introduce and provide updates on jai-ext, imageio-ext, and JAITools. jai-ext provides extended JAI operators that correctly handle NODATA and regione of interests (masks), JAITools provides a number of new raster data analysis operators, including powerful and fast raster algebra support, while ImageIO-Ext bridges the gap across the Java world and native raster data access libraries providing high performance access to GDAL, Kakadu and other libraries.
The presentation will wrap up providing an overview of unresolved issues and challenges that still need to be addressed, suggesting tips and workarounds allowing to leverage the full potential of the systems.
Mapping the world beyond web mercator - FOSS4G 2015GeoSolutions
Most popular mapping presentations today, ranging from clients to servers, show and discuss only maps in EPSG:3857, the popular Mercator derived projection used by OSM as well as
most commercial tiles providers.
There is however an interesting, exciting world of map projections out there, that are still being used in a variety of context. This presentation will introduce the advancement made in GeoTools and GeoServer to handle those use cases, where users have a worldwide data set, and need to view all or part of it in multiple projections, some of which valid in a limited area, and requiring the software to perform a proper display of it on the fly, without any preparation.
We’ll discuss GeoTools/GeoServer “advanced projection handling” manages to deal with these cases, wrapping data, dealing with the poles and the dateline, cutting on the fly excess data, densifying on the fly long lines as needed to ensure a smooth reprojection, for a variety of cases, ranging from seemingly innocuous datum shifts, maps having the prime meridian over the pacific, and the various tricks to properly handle stereographic, transverse mercator, Lambert conic and other limited area projections against world wide source data sets.
Setting up a GeoServer can sometimes be deceptively simple. However, going from proof of concept to production requires a number of steps to be taken in order to optimize the server in terms of availability, performance and scalability. The presentation will show how to get from a basic set up to a battle ready, rock solid installation by showing the ropes an advanced user already mastered.
GeoServer for Spatio-temporal Data Handling With Examples For MetOc And Remot...GeoSolutions
This presentation will provide detailed information on how to ingest and configure SpatioTemporal in GeoServer to be served using OGC services, with examples from WMS and WCS services.
Topics covered are as follows:
- Discussion over existing data formats and how to preprocess them for best serving with GeoServer
- Configuring SpatioTemporal raster and vector data in GeoServer
- Serving SpatioTemporal raster and vector data with OGC Services
- Tips and techniques to optimize performance and allow maximum exploitation of the available data
The attendees will be provided with the basic knowledge needed to preprocess and ingest the most common spatiotemporal data from the MetOc and Remote Sensing field for serving via GeoServer.
Advanced Cartographic Map Rendering in GeoServerGeoSolutions
Various software can style maps and generate a proper SLD document for OGC compliant WMS like GeoServer to use. However, in most occasions, the styling allowed by the graphical tools is pretty limited and not good enough to achieve good looking, readable and efficient cartographic output. For those that like to write their own styles CSS also represents a nice alternatives thanks to its compact-ness and expressiveness.
Several topics will be covered, providing examples in both SLD and CSS for each, including: mastering multi-scale styling, using GeoServer extensions to build common hatch patterns, line styling beyond the basics, such as cased lines, controlling symbols along a line and the way they repeat, leveraging TTF symbol fonts and SVGs to generate good looking point thematic maps, using the full power of GeoServer label lay-outing tools to build pleasant, informative maps on both point, polygon and line layers, including adding road plates around labels, leverage the labelling subsystem conflict resolution engine to avoid overlaps in stand alone point symbology, blending charts into a map, dynamically transform data during rendering to get more explicative maps without the need to pre-process a large amount of views. The presentation aims to provide the attendees with enough information to master SLD/CSS documents and most of GeoServer extensions to generate appealing, informative, readable maps that can be quickly rendered on screen.
Spatio-temporal Data Handling With GeoServer for MetOc And Remote SensingGeoSolutions
This presentation will provide detailed information on how to handle SpatioTemporal metadata in GeoServer for serving with OGC Services, with a particular focus on WMS and WCS.
Enterprise class deployment for GeoServer and GeoWebcache Optimizing perform...GeoSolutions
Setting up a GeoServer can sometimes be deceptively simple. However, going from proof of concept to production requires a number of steps to be taken in order to optimize the server in terms of availability, performance and scalability. This presentation will show how to get from a basic set up to a battle ready, rock solid installation by showing the ropes an advanced user already mastered.
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
After immersing yourself in the blue book and its red counterpart, attending DDD-focused conferences, and applying tactical patterns, you're left with a crucial question: How do I ensure my design is effective? Tactical patterns within Domain-Driven Design (DDD) serve as guiding principles for creating clear and manageable domain models. However, achieving success with these patterns requires additional guidance. Interestingly, we've observed that a set of constraints initially designed for training purposes remarkably aligns with effective pattern implementation, offering a more ‘mechanical’ approach. Let's explore together how Object Calisthenics can elevate the design of your tactical DDD patterns, offering concrete help for those venturing into DDD for the first time!
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Neuro-symbolic is not enough, we need neuro-*semantic*Frank van Harmelen
Neuro-symbolic (NeSy) AI is on the rise. However, simply machine learning on just any symbolic structure is not sufficient to really harvest the gains of NeSy. These will only be gained when the symbolic structures have an actual semantics. I give an operational definition of semantics as “predictable inference”.
All of this illustrated with link prediction over knowledge graphs, but the argument is general.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Encryption in Microsoft 365 - ExpertsLive Netherlands 2024Albert Hoitingh
In this session I delve into the encryption technology used in Microsoft 365 and Microsoft Purview. Including the concepts of Customer Key and Double Key Encryption.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
GDG Cloud Southlake #33: Boule & Rebala: Effective AppSec in SDLC using Deplo...James Anderson
Effective Application Security in Software Delivery lifecycle using Deployment Firewall and DBOM
The modern software delivery process (or the CI/CD process) includes many tools, distributed teams, open-source code, and cloud platforms. Constant focus on speed to release software to market, along with the traditional slow and manual security checks has caused gaps in continuous security as an important piece in the software supply chain. Today organizations feel more susceptible to external and internal cyber threats due to the vast attack surface in their applications supply chain and the lack of end-to-end governance and risk management.
The software team must secure its software delivery process to avoid vulnerability and security breaches. This needs to be achieved with existing tool chains and without extensive rework of the delivery processes. This talk will present strategies and techniques for providing visibility into the true risk of the existing vulnerabilities, preventing the introduction of security issues in the software, resolving vulnerabilities in production environments quickly, and capturing the deployment bill of materials (DBOM).
Speakers:
Bob Boule
Robert Boule is a technology enthusiast with PASSION for technology and making things work along with a knack for helping others understand how things work. He comes with around 20 years of solution engineering experience in application security, software continuous delivery, and SaaS platforms. He is known for his dynamic presentations in CI/CD and application security integrated in software delivery lifecycle.
Gopinath Rebala
Gopinath Rebala is the CTO of OpsMx, where he has overall responsibility for the machine learning and data processing architectures for Secure Software Delivery. Gopi also has a strong connection with our customers, leading design and architecture for strategic implementations. Gopi is a frequent speaker and well-known leader in continuous delivery and integrating security into software delivery.
UiPath Test Automation using UiPath Test Suite series, part 3DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 3. In this session, we will cover desktop automation along with UI automation.
Topics covered:
UI automation Introduction,
UI automation Sample
Desktop automation flow
Pradeep Chinnala, Senior Consultant Automation Developer @WonderBotz and UiPath MVP
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
UiPath Test Automation using UiPath Test Suite series, part 3
GeoServer, GeoNetwork and INSPIRE: where we are and what is missing
1. Creare SDI INSPIRE Ready con
GeoNetwork e GeoServer
Ing. Andrea Aime, GeoSolutions
Ing. Simone Giannecchini, GeoSolutions
Ing. Emanuele Tajariol, GeoSolutions
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
2. Outline
Who is GeoSolutions?
What GeoServer can do for you
What GeoNetwork can do for you
INSPIRE
Where we are and where we should be
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
3. GeoSolutions
Founded in Italy in late 2006
Expertise
• Image Processing, GeoSpatial Data Fusion
• Java, Java Enterprise, C++, Python
• JPEG2000, JPIP, Advanced 2D visualization
Supporting/Developing FOSS4G projects
GeoTools, GeoServer
GeoNetwork, GeoBatch
ImageIO-Ext
Focus on Consultancy
agencies, large private companies, etc…
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
4. GeoServer
GeoSpatial enterprise gateway
Java Enterprise
Management and Dissemination of
raster and vector data
Standards compliant
OGC WCS 1.0, 1.1.1 (RI), 2.0 in the
pipeline
OGC WFS 1.0, 1.1 (RI), 2.0
OGC WMS 1.1.1, 1.3
OGC WPS 1.0.0
Google Earth/Maps support
KML, GeoSearch, etc..
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
5. ----------
----------
----------
---------
PNG, GIF
----------
Shapefile ----------
--------- WMS JPEG
---------- 1.1.1 TIFF,
1.3.0
Formats and Protocols
Vector files
GeoTIFF
PostGIS SVG, PDF
Oracle Styled KML/KMZ
Google* maps
H2
DB2
SQL Server Shapefile
MySql WFSv* GML2
GeoServer
Spatialite GML3
DBMS
GeoCouch WFS GeoRSS
1.0, 1.1, Raw vector GeoJSON
data
2.0 CSV/XLS
ArcSDE
WFS WPS
1.0.0 GeoTIFF
Servers WCS ArcGrid
GeoTIFF 1.0 GTopo30
WMS 1.1.1 Raw raster
Img+World
ArcGrid data
GTopo30 GWC
Img+world (WMTS, KML superoverlays
Mosaic Raster files TMS, Google maps tiles
MrSID WMS-C) OGC tiles
JPEG 2000 OSGEO tiles
ECW,Pyramid, Oracle GeoRaster, PostGis Raster
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
6. Architecture
WCS WMS WFS WFSv REST Google GWC
GeoTools
ImageIO JAI JTS
GDAL Kakadu JAITools
Vector Style Raster
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
8. Integrated Security
Spring Security
RBAC on layers and services
Built-in version with simplified rules
namespace.layer.mode=role1,role2,...
A name, or * to r: read The roles that will
mean “any” w: write be authorized to
access the data
under this rule
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
9. Integrated Security
*.*.r=*
RDONLY
*.*.w=NO_ONE lock down
private.*.r=TRUSTED_ROLE
private.*.w=TRUSTED_ROLE Per-layer
override
topp.districts.w=LEGISLATORS
topp. Other
private.* topp.* districts layers
TRUSTED_ROLE r/w r r r
LEGISLATORS (no access) r r/w r
(all other users) (no access) r r r
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
11. Security Developments in 2.1
Security Management at the feature level (record
in DBMS) read and write filtering
Hide sensible attributes
Discriminate visible areas on a per-user basis
Rules for services and layers
Server side framework available, open source
implementation needed!
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
12. Security Developments in 2.2
Pluggable user sources, available out of the box:
LDAP
DBMS
Pluggable authentication mechanisms, available
out of the box:
BASIC/DIGEST HTTP
CAS
Possible to integrate with other mechanisms and
in-house solutions
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
13. RESTful Configuration
Programmatic configuration of layers via REST
calls
Workspaces
DataStores/CoverageStores
Layers and Styles
Exposing internal configuration to remote clients
Ajax-JavaScript friendly
“Core” Module since 2.1
Integrated Security
Admin credentials required for modifications
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
14. WFS
Dissemination and filtering of vector data
WFS 1.0 and 1.1 support with transactions
WFS 2.0 on trunk
Formats:
GML 2, 3.1 e 3.2
GeoRSS, GeoJSON
Shapefile (zipped)
OGR (configurable)
Extensions
CQL
WFS 1.0 with on-the-fly reprojection
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
15. WCS*
Raster data dissemination
Raw raster data useful for analysis, no maps!
Support for TIME and ELEVATION (via ImageMosaic plugin)
WCS 1.0 e 1.1.1
WCS 2.0 being discussed
Output formats
GeoTiff, ArcGrid
GDAL based formats*
Extensions
ELEVATION as band management*
Refactor Ongoing!
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
16. WMS
Dissemination of Maps
Fusing raster and vector data seamlessly
With styling!
WMS 1.1.1 and 1.3 support
INSPIRE!
SLD
Basic support for SLD 1.1 and SE 1.1
Full support for SLD 1.0
Many rendering extensions available!
Integration with GeoWebCache
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
17. KML/KMZ
TEMPORAL SERIES
KML EXTRUDE KML SUPEROVERLAY
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
18. Advanced Projection Handling
Management of dateline
Change and
map-wrapping
Cutting un-reprojectable
geometries
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
19. Raster Symbolizer
Raw 256
Data Colors
65536
Colors
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
22. Advanced Styling
Geometry
Filter Functions Transformations
Drop
Number Shadow
Formatting
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
23. Advanced Styling
Continuous Maps
CSS Styling
<PolygonSymbolizer>
<Fill> <!-- CssParameters allowed are fill (the color) and fill-opacity -->
<CssParameter name="fill">#4DFF4D</CssParameter>
<CssParameter name="fill-opacity">0.7</CssParameter>
</Fill>
</PolygonSymbolizer>
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
24. WMS - CQL
GeoServer WMS – CQL Examples
STATE_NAME = 'Montana'
MALE > FEMALE
LAND_KM > 300000
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
25. Rendering transformations
On-the-fly data transformations
Calling WPS processes from SLD docs
Optimized for performance
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
26. Rendering transformations
Point feature extraction from two band raster data
(e.g. Wind(u,v))
Computation of direction and module from SLD
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
27. ImageIO-Ext Support
JAI ImageIO Extension
Plugins:
BigTiff
netCDF-CF, GriB1
MatFile 5
HDF4
JP2000 (Kakadu)
GDAL 1.8.1
GDAL integration via ImageIO-ext
JPEG2000,MrSID, ECW
BigTIFF, ERDAS Image, HDF4
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
28. GeoWebCache Integration
Direct calls to GeoServer
GeoServer rendering engine
Support for layers modified
through WFT-T
GeoWebCache Support for various tile
protocols
GMap, Gearth
OpenLayers, VEarth,
Bing
Speed-up factor 10/100
Disk quota support
Persistent raster/KML
tile cache
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
29. Improved Raster Reprojection
Raster reprojection complex
process
Idea:
try to approximate the overall
transformation with a simpler
one, either a single affine
transformation or a piecewise
composition of them (grid warp)
Ability to specify threshold for error
acceptance
Iterative approach (local optimization)
Trade off between speed and
precision
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
30. SQL Parametric Views
SQL View as a GeoServer Layer
No need to actually creating a view in the database
View can be parametric
WMS and WFS allow parameter substitution
….&request=GetMap&viewparams=low:2000000;high:5000000
Default values for parameters
Validation with regular expressions
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
31. Virtual Services
Expose multiple OGC service endpoints per installation
One virtual service per workspace
Expose only layers defined in such workspace
Use cases:
Provide clients with focused/theme centered data sets
Provide each department of a single organization with its own set
of services
Limitations:
Single administrator for the whole server
Service metadata (point of contacts and the like) still configured
centrally
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
32. WMS* Cascading
GetMap and GetFeatureInfo
Cascading
Support for reprojection
on-the-fly
GUI based mass import of
remote layers
TODO: Securing unsecure
WMS Services
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
33. WPS*
WPS 1.0
Official Extension
Raster and Vector data support
High performance processes development (raster/vector
statistics, raster/vector format conversions and more)
Integrated WPS
Automatic publishing of results
Embedding processes into SLD styles
Reuse processes as rendering transformations
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
34. WPS*
Deficiencies
No support for asynchronous requests
Missing request limits enforcements (e.g. input/output
maximum dimensions)
Wish list:
Scripting (Jython, GeoScript)
Sextante, IDL, JGrass (Grass?) integration
Improved robustness
Jiffle (jai-tools) based raster algebra
Create new layers as dynamic WPS processes
(computing data on the fly as requested)
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
35. Complex Feature*
Application/community schemas
Complex Features
Attributes as sub-features
Attributes as list of features
Tree-like structure
Heterogeneous data sources
INSPIRE!
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
36. WMS TIME and ELEVATION
TIME = 20100512T0000000Z
ELEVATION = 0.0
FeatureType Editor
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
37. Raster Pyramids
Preprocessing raster data for performance
Multiple resolutions levels
Scale decide best resolution level
Multiple file (tiles) per resolutions level
File Based Pyramids Support
DBMS-based Pyramids
Postgis
DB2
Oracle (GeoRaster)
MySQL
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
38. GeoNetwork
(GeoSpatial) Catalog
Registry of Metadata
Repository
Enterprise Search Appliance
GeoPortal
SDI entry point
Information Broker
Metadata Editor
Standards Based
Implemented with Java Enterprise technologies
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
39. Technologies
Java Enterprise
Apache Lucene for speed light search
Support for different backends
MYSQL, Oracle, Postgresql, etc..
XSL Templates for flexible presentation
XML Schema
Metadata Validation and Editing
Support for Enterprise Security
LDAP
Shibboleth
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
40. Standards
ISO TC 211 Others
19110:2005
FGDC
19115:2003
19115:2005
OpenSearch Geo
19119:2005 RSS/GeoRSS
19139:2007
WebDAV
23950/Z39.50
OGC OAI-PMH
CSW 2.0.2 (ISO Dublin Core
Profile)
INSPIRE
Discovery Service
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
41. Catalogue/Registry
Manage, Publish and
Search collections of
metadata about Data,
Services and related
information
ISO 19115 Metadata
about Data
ISO 19119 Metadata
about Services
Enterprise Unique
entry point
Act as a Broker (SOA)
Can work in federation
Multilingualism
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
42. Repository
GeoNetwork can be used as a repository
for the data it describes
Authorization on data are independent from
authorization on related metadata
Easy-to-use editor controls to upload data
and set automatically the onLineResource
URL
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
43. Catalogue/Registry - Federation
Multiple Registries for Multiple Enterprise Clouds
Different data/services
Different Organizations
Federation reduces complexity
Available Paradigms
Harvesting
Synchronized Local Copy of remote Metadata
Remote Search
Federating node as NoCache proxy for queries
GeoNetwork support both
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
44. Enterprise GeoPortal
User Friendly Search/View
GeoPortal
Customizable Presentation
Search Forms
Results Presentation
Based on XSL templates
Embedding in third party sites
Integrate with A&A layers
Different views for different
roles
Metadata Profiling
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
45. Enterprise GeoPortal
Metadata Profiling
Authentication
Internal user management for smaller deploys
LDAP integration
Shibboleth integration (federated SSO)
Authorization
User groups (grants on metadata)
User profiles (grants on operations)
Metadata access authorization is fine grained at group
level
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
46. Metadata Editor
Terms and Rules from ISO 19115 and 19119
Encoding in 19139, FGDC and Dublin Core
Intuitive Web-Based Editor with Validation
Identification Section
Distribution Section
Reference System Section
Data Quality Section
Metadata Section
Highly Customizable
Presentation
Validation
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
47. Metadata Editor
Additional capabilities
Extensible Templates’ set
Visual Validation
Extensive online resource
management (WMS, File
download, etc..)
Additional Metadata Linking
(dataset/service,
parent/child, feature
catalog/dataset metadata)
Role assignment for
presentation profiling
Multilingual Support
Batch Import/Insert from XML
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
48. INSPIRE
Infrastructure for Spatial Information in the
European Community
2007/2/EC Directive, 14/03/2007
Fully in place by 2019
Implementing Rules and Technical Guidance to
implement EU-wide Interoperable SDIs
IR are legally binding
TC are not legally binding
Main Aspects Covered
Metadata
Network Services
Data and Service Sharing
Data Specification
Monitoring and Reporting
Maximum Reuse of existing standards (OGC, ISO, W3C)
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
49. INSPIRE – Network Services
Discovery Services
View Services
Download Services
Transformation Services
Invoke Spatial Data Services
Rights Management Layer
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
50. INSPIRE – Discovery Services
Discovery of spatial dataset and services
Provide operations on services
query about service capabilities
register other federated Discovery Services
Provide operations on metadata
search
update (both push and pull modes),
perform federated searches
Based on Metadata specs from ISO
TG requires CSW 2.0.2 ISO AP as starting point
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
51. INSPIRE – Download Services
Account for copies of spatial dataset, or parts of
them to be downloaded and/ accessed directly
Predefined Dataset (or part) VS Direct access
Presence of Query Capabilities
Different Discovery Metadata
Based on OGC WFS 2.0 and ISO/DIS 19142, 19143
for Direct Access
May allow WFS 1.1 in the future
Support for European CRS is Mandatory (See
Annex I of directive)
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
52. INSPIRE – Download Services
Support for GML 3.2.1 is Mandatory
SOAP Encoding is suggested
Multilingualism Support is key
Support for the Temporal dimension is Mandatory
Support for Vector Data is rather mature
Support for Raster Data is unclear
WCS 1.1.2? WCS 2.0?
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
53. INSPIRE – View Services
Display, Navigate, zoom in/out, pan or overlay
viewable dataset and legend information
Based on OGC WMS 1.3.0 – ISO 19128 with OGC
SLD and SE
INSPIRE Profile
WMTS 1.0.0 for tile services with INSPIRE
extensions
WMS 1.1.1 (INSPIRE PROFILE) is also acceptable
2 Available Scenarios
Scenario 1: GetCapabilities document is extended with a link to a
Catalogue
Scenario 2: Extra elements are embedded into the GetCapabilities
document itself
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
54. INSPIRE – View Services
Support for European CRS is Mandatory (See
Annex I of directive)
SOAP support is suggested
Support for the Temporal data dimension
Mandatory output formats for Maps are PNG and
GID
Multilingualism Support is key
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
55. INSPIRE – InvokeSD Services
Invoking individual spatial services as well as
combinations of them
synchronously or asynchronously
Middleware per processing
Technical Papers recommend OGC WPS as basic
building block
BPEL is recommended between the others for
Service Chaining and Workflow
SOAP should be mandatory
IR and TG not available yet
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
56. INSPIRE – Who does What
Discovery service GeoNetwork
View, Download, InvokeSD, Transformation
Service GeoServer
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
57. INSPIRE Discovery Services
GeoNetwork
GeoNetwork implements CSW 2.0.2 ISO Profile
INPIRE extended constraints in metadata should
be explicitly enabled in GeoNetwork
Complies with almost all main requirements in
Metadata Implementation and Discovery Services
Main compliancy issues in:
Handling federated catalogues
in Discovery Service Metadata and Link Discovery Service
operations
Federated metadata retrieving
no CSW, only Z39.50
Publishing in pull mode
matching CSW Harvest operation in GN is not stable yet
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
58. INSPIRE View Services
GeoServer
Historically well supported WMS 1.1.1
GeoServer Stable 2.1.x Supports WMS 1.3
Ordnance Survey (UK) funded the work
INSPIRE compliancy still partial
Harmonized Names (available since 2.2.0 beta)
SOAP Support missing (recommended, not mandatory)
Scenario 2 not supported
Partial support for multilingualism
INSPIRE Community Extension
Separate plugin
Plugs-in additional
fields for Multilingualism
and Service Metadata
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
59. INSPIRE View Services
GeoServer
Language support:
Single language declaration support
Limitations
No multilingual metadata on layers
Missing localized support for exceptions
Missing localization support for contents (e.g.,
GetFeatureInfo, GetMap labels)
Robust support for Mandatory CRS (ETRS89)
Support for Mandatory Encoding Formats (PNG,
GIF)
Support for SLD 1.0 solid and mature
Many Additional Vendor Options
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
60. INSPIRE View Services
GeoServer
Support for SE 1.1 present
extra operations available in SE 1.1 and not in
SLD 1.0 are not supported
Some of the above are available as SLD 1.0
vendor extensions (same functionality, different
syntax)
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
61. INSPIRE View Services
GeoWebCache
Fully support for WMTS 1.0 (tiled view services)
Harmonized names possible
INSPIRECRS84QUAD tile matrix set not built-in,
but manually configurable
Missing INSPIRE extensions:
WMTS Capabilities document does not contain
the required INSPIRE extensions (WMS-C do
though)
No layer metadata links
Internationalization support missing
No SOAP support
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
62. INSPIRE Download Services
GeoServer
GeoServer 2.2.0 beta first release to support WFS
2.0 and GML 3.2.1
IGN France Funding
SOAP supported
Missing some functionalities
Standard Capabilites Extension missing
Local and Remote Resolve
GetPropertyValue Interactions with
AppSchema/Complex Features
Basic Workflow for Complex features
Store original datasets in ad hoc schema database
Generating Object-Relational mappings
On-the-fly output transformations
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
63. INSPIRE Coordinate
Transformation Services - GeoServer
GeoServer provides coordinate transformation
tools with the gs:Reproject WPS process
Requires some changes to become compliant
Name change
List supported SRS
Use different mime types for GML
Add “test transformation” mode (does not
actually transform, checks only if possible)
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
64. INSPIRE InvokeSD Services
GeoServer
GeoServer Support OGC WPS 1.0.0
Interaction with external WFS and WCS
Automatic Ingestion of produced data
Basic process chaining is supported
Interaction with BPEL/BPMN engine to be
tested
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
65. The End
Questions?
simone.giannecchini@geo-solutions.it
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
66. Security Developments in 2.1
GSIP 57 extended authorization management
GeoRepository
Role Base Access Control
Services
Operations
Layers
Attributes (alphanumeric and geospatial)
External Web Application
Web Services + UI
Rule-based
IPTables-like
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
67. Security Developments in 2.1
GeoRepository
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
68. RESTful Configuration
Automatic Configuration Styles
of recurring flows of data Javascript
client
GeoBatch
GeoServer
Server side Desktop
scripts Mass
app
publishing of
Layers Layers
Publishing
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
69. WPS*: demo builder
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
70. Image Server*
Turning GeoServer into an Image Server
Serving pure Imagery
No geo-reference need/available/(would make sense!)
Special Coordinate Reference Systems defined
Interoperability with WMS clients
Respecting EPSG conventions
EPSG:404000
See here
Improved support for data with
bad/missing geo-reference!
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
71. Aggregating data store
N layers, remote or local, sharing the same structure
Aggregating store puts them together dynamically, the
client wil think there is just one layer
Parallel data fetching
Can be configured to tolerates
temporarily unreachable data
sources
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
72. Cross-Layer filtering
“querylayer” community module
“Find all sites within 100 meters from roads”
Single CQL filter with WMS:
DWITHIN(
the_geom,
256
collectGeometries(
Colors
queryCollection('roads',
'the_geom',
'INCLUDE')
),
200, meters)
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
73. Improved Clustering
New parameters to allow multiple GeoServers to work
against the same network shared data directory
Per server log file location
Disabling GWC meta store
Disabling GWC disk quota management
GeoWebCache Enhancements
disable the embedded GWC completely,
hide the embedded GWC to the public
keep the embedded GWC only for fast layer seeding
only one GWC at a time is allowed to write on disk
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012
74. WMS Animator
Animations for WMS requests across custom GetMap
params
Controlled via aparam/avalues couples
Generates multiple frames through multiple GetMap requests
http://localhost:8080/geoserver/wms/animate?LAYERS=topp%3Aworld&apara
m=time&avalues=2004-01-01T00:00:00.000Z,,2004-07-
01T00:00:00.000Z&format=image/gif;subtype=animated&format_options=gif_l
oop_continuosly:true
Workshop di PTA Interreg, La Salle (AO)
8 Maggio 2012