GSIF utilities
Upcoming SlideShare
Loading in...5
×
 

GSIF utilities

on

  • 712 views

 

Statistics

Views

Total Views
712
Views on SlideShare
710
Embed Views
2

Actions

Likes
0
Downloads
14
Comments
0

1 Embed 2

https://www.linkedin.com 2

Accessibility

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

GSIF utilities GSIF utilities Presentation Transcript

  • Global Soil Information FacilitiesSoftware developmentsTomislav HenglISRIC  World Soil Information, Wageningen University GSM2011.org, June 2024th 2011
  • Acknowledgement 1. Hannes Reuter  GIS and WPS functionality. 2. Pierre Roudier & Dylan Beaudette  plotKML package. 3. Brendon Malone & David Jacquier  spline tting function. 4. Keith Shepherd & Bob MacMillan  Soil Reference Library. GSM2011.org, June 2024th 2011
  • GSIF components 1. Cyber infrastructure for input, analysis and visualization of data. 2. Global databases (legacy data, gridded covariates) that are main inputs to global soil mapping. 3. Software tools (modules and packages) and manuals for creation of geoinformation, for instance, according to the GlobalSoilMap.net specications. 4. Standards and protocols for data entry, map generation and data sharing. GSM2011.org, June 2024th 2011 View slide
  • Book chapter GSM2011.org, June 2024th 2011 View slide
  • Overview Open Soil Profiles Soil covariates (worldgrids) Global Continental scale Country/state-level Soil variables Soil site info Soil analytical data Descriptive properties 5.6 km repository 1 km repository 250 m repository R packages Map import module Data entry module Harmonization module Spline fitting Spatial analysis module (Servers) cyber infrastructure Data visualization Data export Soil property maps Webmapping API Six+four key soil parameters Global coverage (organic carbon, pH, clay, silt, sand, coarse fragments) Real-time spatial prediction at six standard depths (0-5, 5- (Google Maps) 15, 15-30, 30-60, 60-100, 100- GlobalSoilMap.net functionality 200 cm) for web-applications and with included upper and Geo-serving and geoprocessing lower 95% probability ranges functionality 100 m (250 m, 1 km and 5.6 km) GSM2011.org, June 2024th 2011
  • GSIF modules New soil profile New covariates data MAP IMPORT MODULE DATA ENTRY MODULE Upload of gridded maps to the soilprofiles.org: live data soilgrids.org repository; entry forms for point data; HARMONISATION MODULE Meta-data generation tool; Geo-registry module; Translation of laboratory Automated map matching and Automated data screening and methods (correlation) validation (mask maps); detection of gross errors and Upscaling / downscaling Automated conversion and artifacts; functionality harmonization of soil polygon Data translation (re- maps; formatting) functionality SPATIAL ANALYSIS MODULE Overlay (covariates) and regression analysis; Multiscale prediction - trend models; Variogram analysis (automap); Prediction and simulations; Cross-validation; Predict secondary soil Open Soil Profiles Soil Gridded Covariates (soilprofiles.org) parameters (PTF) (soilgrids.org) DATA EXPORT MODULE SUPPORT MODULE Subsetting and export to GIS Help and F.A.Q. data formats (geotiff and ESRI Variable descriptions Shape file), KML and table (meta-data) formats (DBF); Search functionality API services to serve the data (manuals and user without accessing URL (e.g. forums, demos and via mobile-phone); multimedia) Data serving Soil property maps (globalsoilmap.net) GSM2011.org, June 2024th 2011
  • Proposed implementation 1. Produce a suite of utilities to import, re-format, analyze and visualize spatial soil data GSM2011.org, June 2024th 2011
  • Proposed implementation 1. Produce a suite of utilities to import, re-format, analyze and visualize spatial soil data 2. Design them so they t the needs of operational global soil mapping GSM2011.org, June 2024th 2011
  • Proposed implementation 1. Produce a suite of utilities to import, re-format, analyze and visualize spatial soil data 2. Design them so they t the needs of operational global soil mapping 3. Focus on using R+OSGeo GSM2011.org, June 2024th 2011
  • Proposed implementation 1. Produce a suite of utilities to import, re-format, analyze and visualize spatial soil data 2. Design them so they t the needs of operational global soil mapping 3. Focus on using R+OSGeo 4. Get the whole DSM community involved (in design, in development, in use) GSM2011.org, June 2024th 2011
  • Proposed implementation 1. Produce a suite of utilities to import, re-format, analyze and visualize spatial soil data 2. Design them so they t the needs of operational global soil mapping 3. Focus on using R+OSGeo 4. Get the whole DSM community involved (in design, in development, in use) 5. Provide training in development and use to countries and nodes GSM2011.org, June 2024th 2011
  • List of utilities 1. Global soil mapping (core) package  GSIF GSM2011.org, June 2024th 2011
  • List of utilities 1. Global soil mapping (core) package  GSIF 2. Soil visualization package  plotKML GSM2011.org, June 2024th 2011
  • List of utilities 1. Global soil mapping (core) package  GSIF 2. Soil visualization package  plotKML 3. Soil Reference Library  SRL GSM2011.org, June 2024th 2011
  • List of utilities 1. Global soil mapping (core) package  GSIF 2. Soil visualization package  plotKML 3. Soil Reference Library  SRL 4. Geo-services (PythonWPS, Geoserver, RServe, GDAL utilities) GSM2011.org, June 2024th 2011
  • Functionality (GSIF) Estimate the spatial domain and the tiling system; Fit splines to soil horizon records and convert from block to point support in vertical dimension; Query and download point and gridded data from the data portals; Convert harmonized soil prole data from relational structure to single table records; Automatically lter suspicious records and detect outliers in the soil prole records; Generate one set of globally consistent predictions using point observations (OSP) and gridded predictors (worldgrids); Convert gridded predictions to formats required for submission to GSIF; Generate metadata and data analysis reports using XML formats; GSM2011.org, June 2024th 2011
  • Status (GSIF) Progress so far: Derive cell ID for any location in the world and estimate number of 1degree blocks required to map an area (based on a land mask); Fit equal-area splines to soil prole data (the method of Bishop et al. (1999)); Get values at point locations from worldgrids.org (covariates); Convert site-horizon DB to single-table structure; GSM2011.org, June 2024th 2011
  • Functionality (plotKML) Visualize soil proles measurements (using the original soil colors); Visualize soil prole photographs; Plot results of prediction (soil property maps) using standard color schemes; Default distribution model for the GlobalSoilMap.net property maps (?); Visualize uncertainty of the maps; GSM2011.org, June 2024th 2011
  • Soil prole GSM2011.org, June 2024th 2011
  • Soil prole attribute plot GSM2011.org, June 2024th 2011
  • Organic carbon mapped using RK GSM2011.org, June 2024th 2011
  • Soil grids as transparent polygons GSM2011.org, June 2024th 2011
  • Soil type maps GSM2011.org, June 2024th 2011
  • Multiple layers (above each other) GSM2011.org, June 2024th 2011
  • Animations GSM2011.org, June 2024th 2011
  • Why KML? (1) Google Earth is #1: >350 millions of downloads! GSM2011.org, June 2024th 2011
  • Why KML? (2)People that made Google Earth understand statistics GSM2011.org, June 2024th 2011
  • plotKML GSM2011.org, June 2024th 2011
  • SRL package Harmonization of soil prole data; Estimation of secondary soil properties using pedo-transfer functions; Estimation of soil properties using soil spectroscopy; GSM2011.org, June 2024th 2011
  • Overview SOIL REFERENCE Soil Spectral LIBRARY Library Dependent R libraries Soil Reference Data (soil referent profiles with complete Obtain additional laboratory methods, soil description field data soil.spec aqp and scanned soil spectra) soiltexture NO HydroMe Conversion functions Fits (various R packages for generalized Fit conversion requir- linear modeling, fuzzy matching, model parameters ed accur- regression trees etc.) acy? YES Design the Conversion coefficients conversion model (most accurate models to estimate NO standard parameters; extendible) Convers- Estimate values of Unharmonized Standardized value + ion model YES the standardized record (new data) Associated uncertainty available? variable GSM2011.org, June 2024th 2011
  • Status It is not dicult to build a package, but to get soil reference data We would need (at least) 300500 points: Points have to be representative (hypercube sampling, the whole world) Each point should be sampled using standard protocol (soil eld description, soil lab analysis, soil spectroscopy) Project designers need to decide if existing samples can be used as well as new ones We probably need new point samples GSM2011.org, June 2024th 2011
  • ISRIC monolithsFigure: ISRIC referent samples (monoliths) and occurrence probability.Derived using the MaxEnt package (climatic images, HWSD andvegetation maps). GSM2011.org, June 2024th 2011
  • Main principles of programming 1. Hide complexity from the users (scale, eective precision, 3D geostat) 2. Deliver data and results so that no software training is required to open it (KML) 3. Link to R+OSGeo community (do not invent functionality that already exists and is operational) GSM2011.org, June 2024th 2011
  • Why R? 1. It is a trustworthy software because it is open source GSM2011.org, June 2024th 2011
  • Why R? 1. It is a trustworthy software because it is open source 2. It is accessible to anyone via most of Operating Systems GSM2011.org, June 2024th 2011
  • Why R? 1. It is a trustworthy software because it is open source 2. It is accessible to anyone via most of Operating Systems 3. People in developing countries can start picking things up today! GSM2011.org, June 2024th 2011
  • Why R? 1. It is a trustworthy software because it is open source 2. It is accessible to anyone via most of Operating Systems 3. People in developing countries can start picking things up today! 4. It is the fastest growing open source environments for statistical computing GSM2011.org, June 2024th 2011
  • Why R? 1. It is a trustworthy software because it is open source 2. It is accessible to anyone via most of Operating Systems 3. People in developing countries can start picking things up today! 4. It is the fastest growing open source environments for statistical computing 5. It can handle space-time data GSM2011.org, June 2024th 2011
  • Why R? 1. It is a trustworthy software because it is open source 2. It is accessible to anyone via most of Operating Systems 3. People in developing countries can start picking things up today! 4. It is the fastest growing open source environments for statistical computing 5. It can handle space-time data 6. It is professional (made by top-minds in the business) GSM2011.org, June 2024th 2011
  • Next steps Release plotKML and GSIF packages v0.1 Continue developing the functionality via R-forge Use users feedback to improve Optimize the processing speed and improve usability on various platforms Incorporate this functionality within WPS GSM2011.org, June 2024th 2011
  • Would you like to join GSIF? Join the GSIF workshop on Friday GSM2011.org, June 2024th 2011
  • Would you like to join GSIF? Join the GSIF workshop on Friday There are some expectations: GSM2011.org, June 2024th 2011
  • Would you like to join GSIF? Join the GSIF workshop on Friday There are some expectations: 1. You take a responsibility to deliver the functionality on time GSM2011.org, June 2024th 2011
  • Would you like to join GSIF? Join the GSIF workshop on Friday There are some expectations: 1. You take a responsibility to deliver the functionality on time 2. You share most of the Edzer Pebesmas Open data principles GSM2011.org, June 2024th 2011
  • Would you like to join GSIF? Join the GSIF workshop on Friday There are some expectations: 1. You take a responsibility to deliver the functionality on time 2. You share most of the Edzer Pebesmas Open data principles A 3. You should be familiar with R / LTEX GSM2011.org, June 2024th 2011