Why are we talking about this? - Bad data costs time, money and even lives. - FME and FME Server are powerful tools for checking data and providing feedback - Many partners, integrators and users use FME today for Validation and Quality Control

1. CONNECT. TRANSFORM. AUTOMATE.
Validation and Quality Control
with FME and FME Server

2. CONNECT. TRANSFORM. AUTOMATE.
Validation and Quality Control
with FME and FME Server

3. CONNECT. TRANSFORM. AUTOMATE.
Validation and Quality Control
with FME and FME Server

4. CONNECT. TRANSFORM. AUTOMATE.
Outline
 Why are we talking about Validation and QC ?
 What can we check?
 Schema
 Attribute Values
 Geometry
 Etc.
 Validation Workflows on FME Server
 Partner Examples

5. CONNECT. TRANSFORM. AUTOMATE.
Why are we talking about this?
 Bad data costs time, money and even lives.

6. CONNECT. TRANSFORM. AUTOMATE.
Why are we talking about
Validation and Quality Control?
 FME and FME Server are powerful tools for
checking data and providing feedback
 Many partners, integrators and users use FME
today for Validation and Quality Control

7. CONNECT. TRANSFORM. AUTOMATE.
What can we check?
 Schema
 Feature Type Name
 Attribute Present
 Attribute Names
 Attribute Data Types
 Coordinate System

8. CONNECT. TRANSFORM. AUTOMATE.
What can we check?
Checking Schema – Key Tools
 Schema Reader
 FeatureTypeFilter
 StatisticsCalculator
 AttributeClassifier transformer
 XMLValidator Transformer
 JSONValidator

9. CONNECT. TRANSFORM. AUTOMATE.
What can we check?
 Attribute Values
 Values exist
 Data Type (numeric, alpha etc)
 Value within in range
 No duplicates

10. CONNECT. TRANSFORM. AUTOMATE.
What can we check?
Checking Attribute Values – Key Tools
 Tester and TestFilter
 AttributeClassifier
 AttributeRangeFilter & AttributeFilter
 NullAttributeMapper
 Matcher
 DuplicateRemover
 StringSearcher
 StatisticsCalculator

11. CONNECT. TRANSFORM. AUTOMATE.
What can we check?
 Geometry 2D and 3D
 Intersections
 Orientation
 Duplicate Vertices
 Missing Surface Normals
 Invalid Solid Voids
 etc

12. CONNECT. TRANSFORM. AUTOMATE.
What can we check?
Geometry Checking – Key Tools
 GeometryValidator (12 tests and counting)
 Detection and repair
 old transformers bundles in eg Self-Intersector
 GeometryFilter
 Matcher
 SpatialFilter (Sweco example)
 SliverRemover & SpikeRemover
 AreaCalculator & LengthCalculator
 OrientationExtractor

13. CONNECT. TRANSFORM. AUTOMATE.
Validation Workflows on FME
Server
 Submit data via email, upload, directory watcher,
scheduled task
 Provide report or results via email, form, data
download, PDF

14. CONNECT. TRANSFORM. AUTOMATE.
Workspace Example

15. CONNECT. TRANSFORM. AUTOMATE.
Validation Workflows on FME
Server

16. CONNECT. TRANSFORM. AUTOMATE.
Partner Validation Examples
#1 Axmann GeoChecker
1. Users upload data
2. Workspaces Check Schema, Geometry, Attributes
3. Email sent with PDF Report and Bad Data in AutoCAD

17. CONNECT. TRANSFORM. AUTOMATE.
Partner Validation Examples
#1 Axmann GeoChecker
Detailed Reports & AutoCAD File of Errors

18. CONNECT. TRANSFORM. AUTOMATE.
Partner Validation Examples
#2 Veremes - Qualigéo
 Generic Approach to avoid “Chamber of Horrors”

19. CONNECT. TRANSFORM. AUTOMATE.
It's easy
Constraint FME tool
Geometry GeometryValidator
Spatial Relationship SpatialFilter/SpatialRelator
Integrity Constraint Feature Merger
Topology
Attribute Domain String Searcher
Statistic Statistic Calculator
Schema Schema reader
Unique Key Duplicate Remover

20. CONNECT. TRANSFORM. AUTOMATE.
It's complicated

21. CONNECT. TRANSFORM. AUTOMATE.
 Hyper generic workspace
• 1 unique workspace to validate all formats, all
data models, all constraints...
 Using an external description of the data
model and constraints
Solution

22. CONNECT. TRANSFORM. AUTOMATE.
Partner Validation Examples
#3 Metria Sweden
Environmental Monitoring Data – ISO
QC-service
on FME
server
Metadat
a
XML
INSPIRE
WFS/SOS
QC-
report
Metadata
portal
Dataset
GML

23. CONNECT. TRANSFORM. AUTOMATE.
Partner Validation Examples
#3 Metria Sweden
Environmental Monitoring Data – ISO

24. CONNECT. TRANSFORM. AUTOMATE.
Partner Example #4
 1Spatial - UKPostcodeValidator

25. CONNECT. TRANSFORM. AUTOMATE.
Thank You!
 Questions?
 For more information:
 info@safe.com
 www.safe.com