Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Data processing qgis3_foss4g-eu_2017

343 views

Published on

QGIS Desktop is one of the most powerfull Open Software GIS software used in a daily basis. One of its key feature is the data processing module that allows users to process their data from various format and offers a rich set of functionalities, which guarantee a high degree of flexibility. This presentation will focus on this part of QGIS and will describe different way to process your data. It will show how to industrialize your process to be more productive in your daily use of QGIS. We will then describe the next key features of the module in QGIS 3.

Published in: Technology
  • Be the first to comment

Data processing qgis3_foss4g-eu_2017

  1. 1. Data Processing with QGIS 3
  2. 2. 2/30www.camptocamp.com / About me ■ Name: Yves Jacolin ■ Company: Camptocamp (training and support) ■ Twitter: @yjacolin ■ Community: ○ GeoRezo.net moderator and administrator ○ OSGeo-Fr : funding member, president, contributor ○ OSGeo charter member ○ QGIS Documentation Leader
  3. 3. 3/30www.camptocamp.com / Introduction ■ Data processing could help you for: ○ managing and processing your data ○ industrializing your process ■ Processing in QGIS is a light ETL
  4. 4. 4/30www.camptocamp.com / Summary ■ Description of QGIS Processing Feature (in QGIS 2.x) ○ What it is ○ Data source ■ Geoalgorithms ■ Graphical modeler ■ Scripts ■ Tips & Tricks ■ What’s new: QGIS 3.0 and beyond
  5. 5. 5/30www.camptocamp.com / Short description
  6. 6. 6/30www.camptocamp.com / What is Processing in QGIS? ■ Python plugin for data processing ○ Created by Victor Olaya ○ A lot of new feature and improvment since its creation ■ Several providers ○ GDAL-OGR ○ SAGA ○ Orfeo Tools Box ○ GRASS ○ R-Script ○ TauDEM ○ LAStools
  7. 7. 7/30www.camptocamp.com / What is Processing in QGIS? ■ Panels and windows: ○ Options ○ Toolbox ○ Graphical modeler ○ Results viewer ○ Commander
  8. 8. 8/30www.camptocamp.com / Overall Processing features and configuration
  9. 9. 9/30www.camptocamp.com / Configuration ■ Path to providers ■ Activate features ■ Default styling configuration for layers ■ Default extension
  10. 10. 10/30www.camptocamp.com / Data source ■ Read and write all data source from QGIS ■ Internal temporary data source: shapefile ○ Break field name to 10 characters ○ ...
  11. 11. 11/30www.camptocamp.com / Geoalgorithms
  12. 12. 12/30www.camptocamp.com / Finding geoalgorithms ■ By providers: ○ GRASS ○ SAGA ○ GDAL/OGR ■ More from plugin ○ QuickOSM ■ Scripts repository
  13. 13. 13/30www.camptocamp.com / Run an algorithm ■ Refactoring fields algorithm
  14. 14. 14/30www.camptocamp.com / Graphical modeler ■ Build your own custom models from existing algorithms
  15. 15. 15/30www.camptocamp.com / Graphical Modeler ■ Link algorithms each others for a full process
  16. 16. 16/30www.camptocamp.com / Graphical modeler ■ Several data inputs ○ Raster and vector layers ○ Attribut table ○ Boolean, Strings, Number ○ File, extent ■ All modules are available in the graphical modeler
  17. 17. 17/30www.camptocamp.com / Graphical modeler ■ Run your algorithm!
  18. 18. 18/30www.camptocamp.com / Graphical modeler ■ Contextual menu for field: ○ Vector/raster layers: Open an external file ○ Number/string: use of an expression ○ Resulting field: export to a temporary file, a file or use expression ■ Iterating on features
  19. 19. 19/30www.camptocamp.com / Scripts ■ Do you feels limited by the graphical modeler?
  20. 20. 20/30www.camptocamp.com / Custom scripts ■ All same features than before ■ QGIS Python API ■ Just a simple script
  21. 21. 21/30www.camptocamp.com / Custom scripts ■ Iterating ■ Specific action on field ○ Expression ○ Export to a tmp file ○ Batch ○ Log management ○ Help
  22. 22. 22/30www.camptocamp.com / I want more! ■ Tips and tricks ■ The futur!
  23. 23. 23/30www.camptocamp.com / Tips & Tricks ■ Use your scripts and custom algorithms in another algorithm ■ Export scripts ■ Create a menu in QGIS maint interface from models ■ Batch processing
  24. 24. 24/30www.camptocamp.com / Tips & Tricks ■ Download new scripts from public or private git repository
  25. 25. 25/30www.camptocamp.com / The futur! ■ Some limitations: ○ Temporary files (shp) when two processes are linked each other ○ Python scripts ○ Performance issue with lot of data ■ On-going works : ○ Big refactoring by Nyall Dawson - Multi-threading (done) - No temporary file between each processes - Python to C++ (on going) - Models break (on going) - Removing duplicate algorithms
  26. 26. 26/30www.camptocamp.com / UI Refreshing
  27. 27. 27/30www.camptocamp.com / Move Processing options to QGIS settings
  28. 28. 28/30www.camptocamp.com / Huge thanks to all contributors!
  29. 29. 29/30www.camptocamp.com / Thanks! ■ Twitter: @yjacolin ■ Email: yves.jacolin@camptocamp.com

×