FME Workbench is a software. For every software in Software Development Life Cycle (SDLC) testing phase must be implemented and performed. Developer by creating FME Workspace is writing code but via very friendly User Interface. Ready FME Workspace generates some output data which should be “tested somehow” against requirements to ensure the quality level is the highest. The answer on “tested somehow” is applying FME Integration Universal Test Framework (FIUTF) or idea and concept of this framework. The data testing concept is very simple, just compare (test cases assertion) FME Workspace writer output (actual) vs. prepared earlier “golden” output (expected) and collect test report (passed/failed tests). FIUTF is mainly FME Workbench which could be adapted in many ways (even in Jenkins CI/CD) on both - FME Desktop and FME Server. FIUTF generates test report automatically for the most popular input data formats as: CSV, GDB, GeoJSON, SHP, GPKG, GML, SQLite, DGN, DXF. Test report is prepared in very readable form in .html or .xls and contains metadata with tests cases as: tests data structure, tests data values, tests data geometry. Additionally, data visualization and potential data defects are presented on .html map to better identify where the issue exists. During presentation, author is going to demo FIUTF to engage audience to automating testing output data of the FME software which they like the most. For more details just visit FME Hub where the framework is deployed.

1. FME
Integration Universal
Test Framework
Michal Pilarski

2. The
Peak
of
Data
Integration
20
23
My story of
testing spatial data…

3. The
Peak
of
Data
Integration
20
23
https://ksiegarnia-geograf.pl/

4. The
Peak
of
Data
Integration
20
23
https://devblogs.microsoft.com/oldnewthing/20061027-00/?p=29213

5. The
Peak
of
Data
Integration
20
23
requirements
input data
output data
… FME project

6. The
Peak
of
Data
Integration
20
23
Testing data - concept
requirements
input test data
output expected data
output actual data
FME Workspace

7. The
Peak
of
Data
Integration
20
23 FIUTF
FME Integration Universal Test Framework
output
expected data
output
actual data
• FME - Just a simple FME
Workspace + Python
• Integration – testing final output
of FME Workflow
• Universal – simple, easy, quick
and universal solution
• Test Framework – automated
test cases and test reports

8. The
Peak
of
Data
Integration
20
23 How it works?
output
expected data
output
actual data
FIUTF - FME Workspace
FME Workspace .fmw
Output Test Report
CSV, GDB, GeoJSON, SHP, GPKG, GML, SQLite, DGN, DXF
FILEFORMAT2TEST
WORKSPACE_FILEPATH
ACTUAL_DATA_FILEPATH
EXPECTED_DATA_FILEPATH
REPORT_DIR

9. The
Peak
of
Data
Integration
20
23
What is inside test reports?
TEST CASES
test_columns_number
test_columns_names
test_rows_number
test_column_ID
test_column_LAT
test_column_LON
test_column_LETTER
test_column_CODE
test_column_LETTER_CODE
METADATA
SAMPLE CSV
test_column_geometry (point, line, polygon)
test_data_crs (Coordinate Reference System, example: WGS84)
test_data_bounds (data extent: min_lat, min_lon, max_lat, max_lon)

10. The
Peak
of
Data
Integration
20
23
DEMO

11. FIUTF Workshop

12. ThankYou!
michpil@gmail.com

13. The
Peak
of
Data
Integration
20
23
Actual Expected
Actual Expected
Actual Expected
Actual Expected

14. The
Peak
of
Data
Integration
20
23
FIUTF – Reports

15. The
Peak
of
Data
Integration
20
23
FIUTF – Report Map