IMGeospatial: FME World Tour 2018 Nottingham: FME at the Heart of Everything We Do
1. FME: At the Heart of
Everything We Do
Paul Larcombe
Data Innovation Manager
Warwickshire County Council
2. FLIGHT PLAN
● Introduction to WCC
● FME case studies
● Powering Live Dashboards
● GIS (Geographical Information
Systems) Data Loading & Analysis
● Future plans
5. Varied care provision
Lack of consistent care
quality information
Significant savings targets
against this service area
Desire to ensure client care
and safety
CARE QUALITY PROBLEM
6.
7.
8. QUALITY DASHBOARD WORKFLOW
Automatic
Schedule on
WPPGEOG3
Daily/Weekly
Email Alerts EG: users
needing to be activated
Database Automation
(index defrag, integrity
checks, other checks)
Custom Exception Handling
EG: Alerts if the workspace
breaks
Data Cleaning, Log
Cleaning, Validation,
Formatting of existing tables
not used by FME directly
Data
Sync
9. ADVANTAGES OF USING FME
Pseudonymised and
Aggregated client
information from Mosaic -
Keeping it secure in the
dashboard and connected
database
Data Cleaning:
- Date Formatting
- String Cleaning
- Case by case processing
- Remove junk
- Fill in blanks
- Validate
Gives all data from all sources a
consistent format.
All data will then have
consistent ID’s, column names,
references etc.
Assign and Change data types.
Text to Numeric, String to Date,
Text to Geometry, all is
possible.
Apply format specific
constraints, such as SQL
primary keys, indexes and table
constraints.
Each format has its own set of
options
Create your own transformers, either with an
embedded FME process called a “custom
transformer” or with most programming
languages.
In Quality we use Python and SQL
10. QUALITY RESULT
Very popular system
Instant access to care quality information
Data-driven culture
High level of demand for future dashboard development
12. Devolved budget setting
Inconsistent systems & data
Challenging savings targets
Reducing cost of software
Open source GIS stack
Boundary comparisons
Service location isochrones
21. Provides easy access to web data
via APIs, WMS/WFS reader and
HTML extractor
Read, write & translate all formats
we use: databases, Google drive,
GIS formats, raster images, 3D
Extend functionality by embedding
SQL queries and Python scripts
Create fully automated processes
using batch runners and event
triggers, and generate alerts
22. Further regular API queries
Machine learning
Vehicle sensors/video
processing
Data safe haven/data
warehouse/GDPR