Restructuring data is one of FME’s specialties, and now you can do this more efficiently than ever. Discover the tools available in FME for managing and validating your data’s attributes, with live demos and best practices.
15. Challenge: Data Quality
If you distribute poor quality data
you've amplified the problem.
If you distribute good quality
data you've amplified the
benefits.
Data validation is key to many
FME workflows…
16. Challenge: Conforming to Standards
●ISO 19157 (GIS)
●NCS (CAD)
●OGC
●INSPIRE
●National, local,
your company, etc.
17. Challenge: Which tools to use?
➢ Tester and TestFilter
➢ AttributeCreator (conditional tests)
➢ AttributeClassifier
➢ AttributeRangeFilter & AttributeFilter
➢ NullAttributeMapper
➢ DuplicateRemover
➢ StringSearcher
➢ StatisticsCalculator
19. What can it test?
➢ Type (integer, float, char, xml, json, etc.)
➢ ‘In’ (either a list or range). Good for domain validation
➢ Matches a regular expression
➢ Unique
➢ Not Null
➢ … and more …
20. Interpreting the Results
➢ Summary Attribute:
_fme_validation_message
➢ List of all messages:
_fme_validation_message_list{}
{0} Attribute 'CodePrefix' with value 'ABE' fails check for Matches Regular Expression '[ABCD]{3}'
{1} Attribute 'num_measures' with value '12' fails check for in Range '[0,10]'
{2} Attribute 'CodePrefix' with value 'ABE' fails check for in 'ABC,ABD,TXU,TXV'
22. ● AttributeManager consolidates many attribute
transformers and adds new functionality.
● AttributeValidator helps you ensure your data is
good quality.
● Both of these simplify your workspaces by
reducing the number of transformers needed.