CONNECT. TRANSFORM. AUTOMATE.
Validation and Quality Control
with FME and FME Server
CONNECT. TRANSFORM. AUTOMATE.
Validation and Quality Control
with FME and FME Server
CONNECT. TRANSFORM. AUTOMATE.
Validation and Quality Control
with FME and FME Server
CONNECT. TRANSFORM. AUTOMATE.
Outline
 Why are we talking about Validation and QC ?
 What can we check?
 Schema
 Attri...
CONNECT. TRANSFORM. AUTOMATE.
Why are we talking about this?
 Bad data costs time, money and even lives.
CONNECT. TRANSFORM. AUTOMATE.
Why are we talking about
Validation and Quality Control?
 FME and FME Server are powerful t...
CONNECT. TRANSFORM. AUTOMATE.
What can we check?
 Schema
 Feature Type Name
 Attribute Present
 Attribute Names
 Attr...
CONNECT. TRANSFORM. AUTOMATE.
What can we check?
Checking Schema – Key Tools
 Schema Reader
 FeatureTypeFilter
 Statist...
CONNECT. TRANSFORM. AUTOMATE.
What can we check?
 Attribute Values
 Values exist
 Data Type (numeric, alpha etc)
 Valu...
CONNECT. TRANSFORM. AUTOMATE.
What can we check?
Checking Attribute Values – Key Tools
 Tester and TestFilter
 Attribute...
CONNECT. TRANSFORM. AUTOMATE.
What can we check?
 Geometry 2D and 3D
 Intersections
 Orientation
 Duplicate Vertices
...
CONNECT. TRANSFORM. AUTOMATE.
What can we check?
Geometry Checking – Key Tools
 GeometryValidator (12 tests and counting)...
CONNECT. TRANSFORM. AUTOMATE.
Validation Workflows on FME
Server
 Submit data via email, upload, directory watcher,
sched...
CONNECT. TRANSFORM. AUTOMATE.
Workspace Example
CONNECT. TRANSFORM. AUTOMATE.
Validation Workflows on FME
Server
CONNECT. TRANSFORM. AUTOMATE.
Partner Validation Examples
#1 Axmann GeoChecker
1. Users upload data
2. Workspaces Check Sc...
CONNECT. TRANSFORM. AUTOMATE.
Partner Validation Examples
#1 Axmann GeoChecker
Detailed Reports & AutoCAD File of Errors
CONNECT. TRANSFORM. AUTOMATE.
Partner Validation Examples
#2 Veremes - Qualigéo
 Generic Approach to avoid “Chamber of Ho...
CONNECT. TRANSFORM. AUTOMATE.
It's easy
Constraint FME tool
Geometry GeometryValidator
Spatial Relationship SpatialFilter/...
CONNECT. TRANSFORM. AUTOMATE.
It's complicated
CONNECT. TRANSFORM. AUTOMATE.
 Hyper generic workspace
• 1 unique workspace to validate all formats, all
data models, all...
CONNECT. TRANSFORM. AUTOMATE.
Partner Validation Examples
#3 Metria Sweden
Environmental Monitoring Data – ISO
QC-service
...
CONNECT. TRANSFORM. AUTOMATE.
Partner Validation Examples
#3 Metria Sweden
Environmental Monitoring Data – ISO
CONNECT. TRANSFORM. AUTOMATE.
Partner Example #4
 1Spatial - UKPostcodeValidator
CONNECT. TRANSFORM. AUTOMATE.
Thank You!
 Questions?
 For more information:
 info@safe.com
 www.safe.com
Upcoming SlideShare
Loading in …5
×

Validation and Quality Control with FME and FME Server

388 views

Published on

Why are we talking about this?
- Bad data costs time, money and even lives.
- FME and FME Server are powerful tools for
checking data and providing feedback
- Many partners, integrators and users use FME
today for Validation and Quality Control

Published in: Software
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
388
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
8
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Validation and Quality Control with FME and FME Server

  1. 1. CONNECT. TRANSFORM. AUTOMATE. Validation and Quality Control with FME and FME Server
  2. 2. CONNECT. TRANSFORM. AUTOMATE. Validation and Quality Control with FME and FME Server
  3. 3. CONNECT. TRANSFORM. AUTOMATE. Validation and Quality Control with FME and FME Server
  4. 4. CONNECT. TRANSFORM. AUTOMATE. Outline  Why are we talking about Validation and QC ?  What can we check?  Schema  Attribute Values  Geometry  Etc.  Validation Workflows on FME Server  Partner Examples
  5. 5. CONNECT. TRANSFORM. AUTOMATE. Why are we talking about this?  Bad data costs time, money and even lives.
  6. 6. CONNECT. TRANSFORM. AUTOMATE. Why are we talking about Validation and Quality Control?  FME and FME Server are powerful tools for checking data and providing feedback  Many partners, integrators and users use FME today for Validation and Quality Control
  7. 7. CONNECT. TRANSFORM. AUTOMATE. What can we check?  Schema  Feature Type Name  Attribute Present  Attribute Names  Attribute Data Types  Coordinate System
  8. 8. CONNECT. TRANSFORM. AUTOMATE. What can we check? Checking Schema – Key Tools  Schema Reader  FeatureTypeFilter  StatisticsCalculator  AttributeClassifier transformer  XMLValidator Transformer  JSONValidator
  9. 9. CONNECT. TRANSFORM. AUTOMATE. What can we check?  Attribute Values  Values exist  Data Type (numeric, alpha etc)  Value within in range  No duplicates
  10. 10. CONNECT. TRANSFORM. AUTOMATE. What can we check? Checking Attribute Values – Key Tools  Tester and TestFilter  AttributeClassifier  AttributeRangeFilter & AttributeFilter  NullAttributeMapper  Matcher  DuplicateRemover  StringSearcher  StatisticsCalculator
  11. 11. CONNECT. TRANSFORM. AUTOMATE. What can we check?  Geometry 2D and 3D  Intersections  Orientation  Duplicate Vertices  Missing Surface Normals  Invalid Solid Voids  etc
  12. 12. CONNECT. TRANSFORM. AUTOMATE. What can we check? Geometry Checking – Key Tools  GeometryValidator (12 tests and counting)  Detection and repair  old transformers bundles in eg Self-Intersector  GeometryFilter  Matcher  SpatialFilter (Sweco example)  SliverRemover & SpikeRemover  AreaCalculator & LengthCalculator  OrientationExtractor
  13. 13. CONNECT. TRANSFORM. AUTOMATE. Validation Workflows on FME Server  Submit data via email, upload, directory watcher, scheduled task  Provide report or results via email, form, data download, PDF
  14. 14. CONNECT. TRANSFORM. AUTOMATE. Workspace Example
  15. 15. CONNECT. TRANSFORM. AUTOMATE. Validation Workflows on FME Server
  16. 16. CONNECT. TRANSFORM. AUTOMATE. Partner Validation Examples #1 Axmann GeoChecker 1. Users upload data 2. Workspaces Check Schema, Geometry, Attributes 3. Email sent with PDF Report and Bad Data in AutoCAD
  17. 17. CONNECT. TRANSFORM. AUTOMATE. Partner Validation Examples #1 Axmann GeoChecker Detailed Reports & AutoCAD File of Errors
  18. 18. CONNECT. TRANSFORM. AUTOMATE. Partner Validation Examples #2 Veremes - Qualigéo  Generic Approach to avoid “Chamber of Horrors”
  19. 19. CONNECT. TRANSFORM. AUTOMATE. It's easy Constraint FME tool Geometry GeometryValidator Spatial Relationship SpatialFilter/SpatialRelator Integrity Constraint Feature Merger Topology Attribute Domain String Searcher Statistic Statistic Calculator Schema Schema reader Unique Key Duplicate Remover
  20. 20. CONNECT. TRANSFORM. AUTOMATE. It's complicated
  21. 21. CONNECT. TRANSFORM. AUTOMATE.  Hyper generic workspace • 1 unique workspace to validate all formats, all data models, all constraints...  Using an external description of the data model and constraints Solution
  22. 22. CONNECT. TRANSFORM. AUTOMATE. Partner Validation Examples #3 Metria Sweden Environmental Monitoring Data – ISO QC-service on FME server Metadat a XML INSPIRE WFS/SOS QC- report Metadata portal Dataset GML
  23. 23. CONNECT. TRANSFORM. AUTOMATE. Partner Validation Examples #3 Metria Sweden Environmental Monitoring Data – ISO
  24. 24. CONNECT. TRANSFORM. AUTOMATE. Partner Example #4  1Spatial - UKPostcodeValidator
  25. 25. CONNECT. TRANSFORM. AUTOMATE. Thank You!  Questions?  For more information:  info@safe.com  www.safe.com

×