Do you find yourself with hundreds of thousands or even millions of rows of data that you need to transform and move to another system, but you don’t have months to do it? It’s time you tried FME. Unleash the tool others use to move billions of rows of data on your datasets and trade your data moving problems for a brand new problem — what to do with all that extra time on your hands. During this webinar, we'll go through best practices when building out your next workspace to save you time and enable efficient data analysis across your organization, including: - When it’s time to consider Performance Tuning FME Desktop - Recent changes to FME with bulk-mode that vastly improve performance - Workspace Authoring: feature caching and collapsing bookmarks, feature counts, and reviewing log files - Workspace Design Patterns to refine the volume of data you’re working with It’s time for a workspace tune-up. Join us to learn the best tricks of the trade and get more done in less time by applying the latest advances in FME technology to your problems.

2. Meet the Presenters
Dan Minney
Technical Support Specialist, FME
Desktop
Jenna Kim
Technical Support Specialist, FME
Desktop

3. Welcome to Livestorm!
A few ways to engage with us during the webinar:
Audio issues? Click this for 4 simple
troubleshooting steps.
*Weʼll also bring up a poll on your
screen during the webinar.

4. How to download slides
1. Hover over the slide deck
in the webinar room
2. Click this button

5. Agenda
● Introduction & when itʼs time
Performance Tune FME Desktop
● Workspace Authoring & Design
Patterns
● FME Updates and Improvements
● Post-Mortem Performance
Tuning
● FME Memory Management
● Database Performance Tuning
● Resources + Q&A

6. Chat Storm:
What do you think
“Performance Tuning
FME” means?

7. Today…
Learn how to efficiently build new and
existing workspaces to save time &
fast-track your data translations

8. Sneak peek…

9. When is it Time to Performance
Tune FME Desktop?
Consider the:
● Volume of data
● Complexity of the workflow
● Type of data (spatial vs tabular)
● Time constraints of the tasks
… that you are dealing with.

10. What is the Measure of Performance?
Memory used & memory limitations
Time spent running the workspace & CPU usage
FME Session Duration: 4 minutes 10 seconds. (CPU: 58.0s user, 3.8s
system)
END - ProcessID: 121592, peak process memory usage: 259688 kB, current
process memory usage: 184300 kB

11. Years of solving data challenges
28+
16,000+
Organizations trusting us worldwide
Global partners delivering FME Services
190+
128
Countries with FME customers
Safe Software
Company Profile
www.safe.com
Users active in FME Community
20,000+

12. FME®
Enterprise Integration Platform
FME Desktop
Build & Run Data Workflows
FME Server
Automate Data Workflows
FME Mobile
Deliver the Power of
FME to Mobile
The only Enterprise Integration Solution with comprehensive support for Spatial Data
Powering your dataflows on premises, in the cloud, and on mobile
FME Cloud
FME Server in the cloud

13. Unrivaled Data Support

14. Workspace Authoring and Design
Patterns

15. Attribute Cleaning
● FME holds data in memory or cached to a disk. Enable/Disable Feature caching.
● Remove attributes that are not used in translation, only carry through the
translation.
● AttributeManager, AttributeRemover, AttributeKeeper, GeometryRemover
Read Data
Remove Excess
Attributes
Process Data

16. Data Filtering
● Similar to attributes, excess
features should be removed early
in the process
● Filter your unwanted data early on
in the process so unnecessary
processing doesnʼt occur
● Tester, TestFilter, GeometryFilter

17. Reducing Duplication
● A chain of duplicate transformers could be a sign of a bad design pattern!
● Try to identify steps that can be condensed into a single transformer, such as an
AttributeManager.

18. Some Additional Tips…
● Order your writers in the navigator to ensure the one getting the larger amount of
data is the first to be written
● Take advantage of Group-By mode when available as a parameter transformers

19. Demo
Let's apply what we
learned about attribute
cleaning, data filtering,
reducing duplication

20. FME Updates and Improvements

21. Updates and Improvements
● Updates made to FME can be classified as Automatic or Premeditated.
● Automatic upgrades are applied as you upgrade the FME version and are applied
automatically
● Premeditated upgrades can be controlled by the user.

22. Post-Mortem Performance Tuning

23. Log Timestamps
Tools > FME Options > Translate > Log Settings
● Use Log Timestamps to help assess
stages of the translation that may need
to be re-assessed
● Run a profile to obtain a detailed log of
how much time is spent in each
underlying factory or function
○ Tool > Edit Header
○ Add a path for the report as the first line e.g.
ME_PROFILE_RESULT_CSV
C:TEMPprofile.csv

24. FME Memory Management

25. ● Insufficient computer resources
● Memory intensive applications running simultaneously
● Memory fragmentation
FME Workspace Issues
● Complexity of the workspace - lots of transformers + blocking transformers
● Feature caching
● Bulk mode features are split into individual features
Causes of memory issues

26. Temporary File Storage
FME_TEMP environment variable

27. Tips & Tricks
● Take advantage of Bulk Mode to
keep memory usage down
● Optimize the amount of memory
available to FME
● Adjust the temporary file location
for FME
FME 2022 supports
bulk mode for more
formats than ever
before!

28. Database Performance Tuning

29. Database Indexing
● Indexes are great for searching… less so for appending records to a table
● Indexed tables require the database to index each new record added
● Writing to an un-indexed table means no overhead for the database
Let the Database do the work
● Take advantage of database by querying and filter out data early
● Ex: Sql WHERE statement

30. Indexes vs No Indexes
DROP INDEXES ON:
FME Session Duration: 2 minutes
44 seconds. (CPU: 46.7s user,
2.9s system)
DROP INDEXES OFF:
FME Session Duration: 4 minutes
10 seconds. (CPU: 58.0s user,
3.8s system)

31. Demo

32. Drop & Rebuild Indexes

33. Performance tune your workspace and
reduce time waiting around. Replace this
with a brand new problem — what to do
with all that extra time.

34. Summary
Reduce duplication of transformers &
filter out data early in your workflows
Let the database do the work
Memory management can save you
time and effort

35. Next Steps
Look out for
FME 2022.1 &
the webinar
workspaces
Apply the
workspaces to your
own data to
manage changes
Free Trial | Upgrade
Contact us. We
would love to chat
with you about
anything data
info@safe.com

36. Resources
● Performance Tuning FME
● Feature Caching and Performance
● How FME Improves Performance with Bulk Mode
● Design For Performance

37. Claim Your Community Badge
Get community badges for
watching webinars!
fme.ly/WebinarBadge Todayʼs Code: LPCBG

38. The Peak of Data Integration 2022 UC
August 24-26, 2022 Vancouver, Canada
Register now

39. Check out our upcoming
& on-demand webinars:
safe.com/webinars

40. We Value Your Feedback
Share Your Experience with FME on
Gartner Peer Insights
Gartner Peer Insights content consists of the opinions of individual end users based on their own experiences with the vendors listed on the platform, should not be construed as statements of fact, nor do they
represent the views of Gartner or its affiliates. Gartner does not endorse any vendor, product or service depicted in this content nor makes any warranties, expressed or implied, with respect to this content, about its
accuracy or completeness, including any warranties of merchantability or fitness for a particular purpose. Gartner and Gartner Peer Insights are registered trademarks of Gartner, Inc. and/or its affiliates in the U.S.
and internationally and are used herein with permission. All rights reserved.
Gartner Peer Insights
Reviews from your enterprise peers – verified by Gartner
● Reviews are anonymous and take approximately 10
minutes to complete.
● You will be asked to create a profile using your business
email or LinkedIn account prior to completing the survey
for validation purposes.
Contribute a review today
Email vivian.tang@safe.com if you have any questions

41. Q&A

42. Thank you!
Download FME 2022 Free Trial | Upgrade
Chat with us info@safe.com
Connect with us in the Community
Connect with us for more FME
Please share
your feedback
with us through
the webinar
survey!