1. Multiprocessing in FME
April 2012

2. Multiprocessing: Definition
Multiprocessing is the use of
two or more central processing units (CPUs)
within a single computer system
- Wikipedia

4. Multiprocessing: Motivation
 Multi-Core and HyperThreaded CPUs
 Very common
 Potential to increase compute-bound
throughput

5. Multiprocessing & FME
 Option on Many Transformers
 Multiprocesses
Groups

6. Multiprocessing & FME
 Option on All Custom Transformers

7. Multiprocessing: Levels Of Parallelism
 None
 Minimal
 Moderate
 Aggressive
 Extreme

8. Multiprocessing: Levels Of Parallelism
Parameter Processes
No Parallelism 1 License Cap
Minimal Cores / 2 Base 4
Moderate Cores Professional 8
Aggressive Cores * 1.5 Other 16
Extreme Cores * 2

9. Demonstration – DEM Generation
Parameter Time
No Parallelism 1’ 10”
Minimal 44”
Moderate 33”
Aggressive 37”
Extreme 37”

10. Demonstration - Buffering
Parameter Time
No Parallelism 2’ 51”
Moderate (4) 1’ 29”
Moderate (8) 1’ 30”
Moderate (16) 1’ 33”
Moderate (50) 1’ 54”

11. Demonstration - Clipping
Parameter Time
No Parallelism 27’ 01”
Moderate 7’ 33”

12. Multiprocessing: Summary
 New for 2012
 Leverages Multi-Core and HyperThreading CPUs
 Controlled by:
 Levels of Parallelism
 Group-By
 Can give significant performance boost
 http://fmeevangelist.com/fmeevangelist94
 http://fme.ly/parallel (FMEpedia Article)