The document provides an overview of data processing capabilities in QGIS 3, highlighting features such as geoalgorithms, graphical modeler, and custom scripts. It discusses both the configuration and management of data processing, along with tips and tricks for enhanced usage. The document also mentions ongoing improvements and future developments in the QGIS processing framework.

1. Data Processing with QGIS 3

2. 2/30www.camptocamp.com /
About me
■ Name: Yves Jacolin
■ Company: Camptocamp (training and support)
■ Twitter: @yjacolin
■ Community:
○ GeoRezo.net moderator and administrator
○ OSGeo-Fr : funding member, president, contributor
○ OSGeo charter member
○ QGIS Documentation Leader

3. 3/30www.camptocamp.com /
Introduction
■ Data processing could help you for:
○ managing and processing your data
○ industrializing your process
■ Processing in QGIS is a light ETL

4. 4/30www.camptocamp.com /
Summary
■ Description of QGIS Processing Feature (in QGIS
2.x)
○ What it is
○ Data source
■ Geoalgorithms
■ Graphical modeler
■ Scripts
■ Tips & Tricks
■ What’s new: QGIS 3.0 and beyond

5. 5/30www.camptocamp.com /
Short description

6. 6/30www.camptocamp.com /
What is Processing in QGIS?
■ Python plugin for data processing
○ Created by Victor Olaya
○ A lot of new feature and improvment since its creation
■ Several providers
○ GDAL-OGR
○ SAGA
○ Orfeo Tools Box
○ GRASS
○ R-Script
○ TauDEM
○ LAStools

7. 7/30www.camptocamp.com /
What is Processing in QGIS?
■ Panels and windows:
○ Options
○ Toolbox
○ Graphical modeler
○ Results viewer
○ Commander

8. 8/30www.camptocamp.com /
Overall Processing features and
configuration

9. 9/30www.camptocamp.com /
Configuration
■ Path to providers
■ Activate features
■ Default styling configuration
for layers
■ Default extension

10. 10/30www.camptocamp.com /
Data source
■ Read and write all data source from QGIS
■ Internal temporary data source: shapefile
○ Break field name to 10 characters
○ ...

11. 11/30www.camptocamp.com /
Geoalgorithms

12. 12/30www.camptocamp.com /
Finding geoalgorithms
■ By providers:
○ GRASS
○ SAGA
○ GDAL/OGR
■ More from plugin
○ QuickOSM
■ Scripts repository

13. 13/30www.camptocamp.com /
Run an algorithm
■ Refactoring fields algorithm

14. 14/30www.camptocamp.com /
Graphical modeler
■ Build your own custom models from existing algorithms

15. 15/30www.camptocamp.com /
Graphical Modeler
■ Link algorithms each others for a full process

16. 16/30www.camptocamp.com /
Graphical modeler
■ Several data inputs
○ Raster and vector layers
○ Attribut table
○ Boolean, Strings, Number
○ File, extent
■ All modules are available in the
graphical modeler

17. 17/30www.camptocamp.com /
Graphical modeler
■ Run your algorithm!

18. 18/30www.camptocamp.com /
Graphical modeler
■ Contextual menu for field:
○ Vector/raster layers: Open an external file
○ Number/string: use of an expression
○ Resulting field: export to a temporary file, a file or use
expression
■ Iterating on features

19. 19/30www.camptocamp.com /
Scripts
■ Do you feels limited by the graphical modeler?

20. 20/30www.camptocamp.com /
Custom scripts
■ All same features than before
■ QGIS Python API
■ Just a simple script

21. 21/30www.camptocamp.com /
Custom scripts
■ Iterating
■ Specific action on field
○ Expression
○ Export to a tmp file
○ Batch
○ Log management
○ Help

22. 22/30www.camptocamp.com /
I want more!
■ Tips and tricks
■ The futur!

23. 23/30www.camptocamp.com /
Tips & Tricks
■ Use your scripts and custom algorithms in another
algorithm
■ Export scripts
■ Create a menu in QGIS maint interface from models
■ Batch processing

24. 24/30www.camptocamp.com /
Tips & Tricks
■ Download new scripts from public or private git
repository

25. 25/30www.camptocamp.com /
The futur!
■ Some limitations:
○ Temporary files (shp) when two processes are linked each other
○ Python scripts
○ Performance issue with lot of data
■ On-going works :
○ Big refactoring by Nyall Dawson
- Multi-threading (done)
- No temporary file between each processes
- Python to C++ (on going)
- Models break (on going)
- Removing duplicate algorithms

26. 26/30www.camptocamp.com /
UI Refreshing

27. 27/30www.camptocamp.com /
Move Processing options to QGIS settings

28. 28/30www.camptocamp.com /
Huge thanks to all contributors!

29. 29/30www.camptocamp.com /
Thanks!
■ Twitter: @yjacolin
■ Email: yves.jacolin@camptocamp.com