SlideShare a Scribd company logo
1 of 47
How to Efficiently Transform
Non-Spatial Data using FME


                         March 13, 2013
Who Are We?


         Dale Lutz
          Co-Founder and
          Vice President of Development
          Safe Software



         Aaron Koning
          FME Server Product Manager
          Safe Software
Guest Speakers


              Daniel Riddle
                 GIS Specialist for
                 SYNCADD Systems Inc.



              Kristofor Carle
                 Software Developer for
                 SYNCADD Systems Inc.
Questions are Encouraged!

This morning’s Q&A Support:



                 Mark Stoakes
                 Manager Professional Services
                 Safe Software


                 Iris Gutowski
                 Product Support Specialist
                 Safe Software
FME – Feature Manipulation Engine




Powering The Flow of Spatial Data
FME – Feature Manipulation Engine




   Powering The Flow of Data
FME Capabilities

Transform Data to Use and Share

                      Convertspatial data between
                     hundreds of formats

                      Transformspatial data into the
                     precise data model you need

                      Integratemultiple different data
                     types into a single data model

                      Sharespatial data with people
                     where, when and how they need it
Workbench:
Graphical Data Flow Authoring
New to FME?

  Getting started page:

   http://fme.ly/GetStarted

  Attend a weekly FME Desktop overview
   webinar:

   http://fme.ly/WeeklyIntro
Poll: How much of your data is
Non-Spatial?
Why FME for Non-Spatial?

 Beats Writing Code
   Easier to maintain
   Faster to configure
 Powerful Transformations and Filtering

 Supports Most Common Formats

 Consistent Handling of Spatial and
  Non-Spatial in one tool
SpatializingTransformers
SpatializingTransformers
FME Supported Formats
Poll: What Non-Spatial Formats
are of most interest to you?
1 - Old School Non-Spatial


                Egg Information (CAT)
   NEST_ID EGG_ID DATE_LAID DATE_HATCHED INCUBATION_DAYS
        20      0 20040819      20040826               7
        20      1 20040823      20040829               6
        20      2 20040818      20040826               8
   …




                         Species (CSV)
                    NestId,Species
                    100,BLUE JAY
                    101,AMERICAN GOLDFINCH
                    …
1 - Old School Non-Spatial




             DEMO
 Create a DBF file of:
   Number of Eggs
   Average Incubation

 … for each species of bird
2 – The Office
2 – The Office
2 – The Office




              DEMO
 Reorganize the Vancouver Business
  Licenses Excel File
   Separate tabs for license state
   Create summary tab
   Flag errors into a new file
3 – Hipster
3 – Hipster
3 – Hipster
3 – Hipster




              DEMO
 Check if my electric car needs charging
   Read the Tesla Vehicle Webservice (which returns JSON)
   Explode the JSON
   Check if charging needed
      Send email if yes
      Honk horn if NO
4 – Corporate
4 – Corporate




          DEMO
 Update Oracle with results from
  complex MS SQL Server query
5 – Cloudy
5 – Cloudy




          DEMO
 Publish data from SalesForce to Socrata
    Filter out bad data along the way
    Plus do schema restructuring for data
     sharing
Guest Speakers


              Daniel Riddle
                 GIS Specialist for
                 SYNCADD Systems Inc.



              Kristofor Carle
                 Software Developer for
                 SYNCADD Systems Inc.
Story 1: Data Upload Monitoring


• The Mission: Monitor data uploaded via a web
  interface to an Army Geospatial Data Warehouse
  for compliance and data model validation,
  reporting the results.

• The Solution: Use FME Server and custom
  transformers to run QA tests and email the
  results as Excel spreadsheets.
SYNCADD


• Custom transformers are created and source user
  parameters are published to leverage FME Server.




• Readers Used: Schema; ESRI Personal, File, & SDE
  Geodatabase
SYNCADD



Custom
transformers
complete various
tests on metadata
tags, schema
feature classes, and
schema attributes.
SYNCADD


Results are
exported as
Microsoft Excel
spreadsheets
and emailed to
the user using
FME Server.
Story 2: Non Spatial MS Access ETL


• The Mission: Evaluate, document, and reproduce
  a non-spatial ETL process currently maintained in
  MS Access so that business experts (not just data
  analysts/DBAs) can understand it.

• The Solution: Use FME to reorganize the process
  into diagrams in custom transformers. Add visual
  QA/QC checks directly into the workflow.
SYNCADD


• Before: SQL queries in MS Access
SYNCADD


• After: FME creates a diagram that is easy to understand.
SYNCADD


• Inspection points and FME Data Inspector make it easy
  to evaluate the process even on the fly in a meeting.
• Visually compare link counts on printed diagrams after
  each data import to look for possible problems.
SYNCADD
Summary


 Don’t let the Spatial scare you off!

 FME is a powerful Non-Spatial problem
  solving machine

 FME is not just for the desktop
   FME Server is engineered for enterprise data
    transformation
   Automate your non-spatial workflows
2013 FME World Tour!


                 40+ FME User Meetings
                  happening world wide and
                  one live stream

                 Register
                  atwww.safe.com/worldtou
                  r
Upcoming webinars

 How to Easily Read and Write CityGML Data Using
  FME – March 27

 How to Load Spatial and Non-Spatial Data into
  Terdata using FME – April 3

 PostGIS2.0 – How to Improve Interoperability
  using FME – April 24

Recorded Webinars:
 http://fme.ly/webinars
Poll: Would you like more
information on our free
training options?




 View the offerings at:
    http://fme.ly/online
We’ll Be Following Up
Thank You!

 For more information, contact:
   Sales
      info@safe.com
   Support
      support@safe.com
      (604)501-9985 ext. 278
   Aaron
      aaron.koning@safe.com
   Dale
      dal@safe.com
   Daniel
      daniel.riddle@syncadd.com
   Kristofor
      kristofor.carle@syncadd.com

More Related Content

What's hot

Transforming AutoCAD Data to Smallworld with FME
Transforming AutoCAD Data to Smallworld with FMETransforming AutoCAD Data to Smallworld with FME
Transforming AutoCAD Data to Smallworld with FMESafe Software
 
FME World Tour 2015 - FME & Data Migration Simon McCabe
FME World Tour 2015 -  FME & Data Migration Simon McCabeFME World Tour 2015 -  FME & Data Migration Simon McCabe
FME World Tour 2015 - FME & Data Migration Simon McCabeIMGS
 
Databricks Whitelabel: Making Petabyte Scale Data Consumable to All Our Custo...
Databricks Whitelabel: Making Petabyte Scale Data Consumable to All Our Custo...Databricks Whitelabel: Making Petabyte Scale Data Consumable to All Our Custo...
Databricks Whitelabel: Making Petabyte Scale Data Consumable to All Our Custo...Databricks
 
Talend Introduction by TSI
Talend Introduction by TSITalend Introduction by TSI
Talend Introduction by TSIRemain Software
 
Feature drift monitoring as a service for machine learning models at scale
Feature drift monitoring as a service for machine learning models at scaleFeature drift monitoring as a service for machine learning models at scale
Feature drift monitoring as a service for machine learning models at scaleNoriaki Tatsumi
 
What’s New in Syncsort’s Trillium Software System (TSS) 15.7
What’s New in Syncsort’s Trillium Software System (TSS) 15.7What’s New in Syncsort’s Trillium Software System (TSS) 15.7
What’s New in Syncsort’s Trillium Software System (TSS) 15.7Precisely
 
Sridhar S - Resume - Mar-2016
Sridhar S - Resume - Mar-2016Sridhar S - Resume - Mar-2016
Sridhar S - Resume - Mar-2016Sridhar S
 
Informatica to ODI Migration – What, Why and How | Informatica to Oracle Dat...
Informatica to ODI Migration – What, Why and How |  Informatica to Oracle Dat...Informatica to ODI Migration – What, Why and How |  Informatica to Oracle Dat...
Informatica to ODI Migration – What, Why and How | Informatica to Oracle Dat...Jade Global
 
Machine Learning Models in Production
Machine Learning Models in ProductionMachine Learning Models in Production
Machine Learning Models in ProductionDataWorks Summit
 
2010.03.16 Pollock.Edw2010.Modern D Ifor Warehousing
2010.03.16 Pollock.Edw2010.Modern D Ifor Warehousing2010.03.16 Pollock.Edw2010.Modern D Ifor Warehousing
2010.03.16 Pollock.Edw2010.Modern D Ifor WarehousingJeffrey T. Pollock
 
ETL tool evaluation criteria
ETL tool evaluation criteriaETL tool evaluation criteria
ETL tool evaluation criteriaAsis Mohanty
 
Tableau @ Spil Games
Tableau @ Spil GamesTableau @ Spil Games
Tableau @ Spil GamesRob Winters
 
Big Data and BI Tools - BI Reporting for Bay Area Startups User Group
Big Data and BI Tools - BI Reporting for Bay Area Startups User GroupBig Data and BI Tools - BI Reporting for Bay Area Startups User Group
Big Data and BI Tools - BI Reporting for Bay Area Startups User GroupScott Mitchell
 
BarbaraZigmanResume 2016
BarbaraZigmanResume 2016BarbaraZigmanResume 2016
BarbaraZigmanResume 2016bzigman
 
Resume quaish abuzer
Resume quaish abuzerResume quaish abuzer
Resume quaish abuzerquaish abuzer
 
Feature Store as a Data Foundation for Machine Learning
Feature Store as a Data Foundation for Machine LearningFeature Store as a Data Foundation for Machine Learning
Feature Store as a Data Foundation for Machine LearningProvectus
 
Informatica basics for beginners | Informatica ppt
Informatica basics for beginners | Informatica pptInformatica basics for beginners | Informatica ppt
Informatica basics for beginners | Informatica pptIQ Online Training
 
Configuration Management and Deployment
Configuration Management and DeploymentConfiguration Management and Deployment
Configuration Management and DeploymentSomnathMore3
 
BIG DATA ANALYTICS MEANS “IN-DATABASE” ANALYTICS
BIG DATA ANALYTICS MEANS “IN-DATABASE” ANALYTICSBIG DATA ANALYTICS MEANS “IN-DATABASE” ANALYTICS
BIG DATA ANALYTICS MEANS “IN-DATABASE” ANALYTICSTIBCO Spotfire
 
ERP Data Migration Methodologies
ERP Data Migration MethodologiesERP Data Migration Methodologies
ERP Data Migration MethodologiesAhmed M. Rafik
 

What's hot (20)

Transforming AutoCAD Data to Smallworld with FME
Transforming AutoCAD Data to Smallworld with FMETransforming AutoCAD Data to Smallworld with FME
Transforming AutoCAD Data to Smallworld with FME
 
FME World Tour 2015 - FME & Data Migration Simon McCabe
FME World Tour 2015 -  FME & Data Migration Simon McCabeFME World Tour 2015 -  FME & Data Migration Simon McCabe
FME World Tour 2015 - FME & Data Migration Simon McCabe
 
Databricks Whitelabel: Making Petabyte Scale Data Consumable to All Our Custo...
Databricks Whitelabel: Making Petabyte Scale Data Consumable to All Our Custo...Databricks Whitelabel: Making Petabyte Scale Data Consumable to All Our Custo...
Databricks Whitelabel: Making Petabyte Scale Data Consumable to All Our Custo...
 
Talend Introduction by TSI
Talend Introduction by TSITalend Introduction by TSI
Talend Introduction by TSI
 
Feature drift monitoring as a service for machine learning models at scale
Feature drift monitoring as a service for machine learning models at scaleFeature drift monitoring as a service for machine learning models at scale
Feature drift monitoring as a service for machine learning models at scale
 
What’s New in Syncsort’s Trillium Software System (TSS) 15.7
What’s New in Syncsort’s Trillium Software System (TSS) 15.7What’s New in Syncsort’s Trillium Software System (TSS) 15.7
What’s New in Syncsort’s Trillium Software System (TSS) 15.7
 
Sridhar S - Resume - Mar-2016
Sridhar S - Resume - Mar-2016Sridhar S - Resume - Mar-2016
Sridhar S - Resume - Mar-2016
 
Informatica to ODI Migration – What, Why and How | Informatica to Oracle Dat...
Informatica to ODI Migration – What, Why and How |  Informatica to Oracle Dat...Informatica to ODI Migration – What, Why and How |  Informatica to Oracle Dat...
Informatica to ODI Migration – What, Why and How | Informatica to Oracle Dat...
 
Machine Learning Models in Production
Machine Learning Models in ProductionMachine Learning Models in Production
Machine Learning Models in Production
 
2010.03.16 Pollock.Edw2010.Modern D Ifor Warehousing
2010.03.16 Pollock.Edw2010.Modern D Ifor Warehousing2010.03.16 Pollock.Edw2010.Modern D Ifor Warehousing
2010.03.16 Pollock.Edw2010.Modern D Ifor Warehousing
 
ETL tool evaluation criteria
ETL tool evaluation criteriaETL tool evaluation criteria
ETL tool evaluation criteria
 
Tableau @ Spil Games
Tableau @ Spil GamesTableau @ Spil Games
Tableau @ Spil Games
 
Big Data and BI Tools - BI Reporting for Bay Area Startups User Group
Big Data and BI Tools - BI Reporting for Bay Area Startups User GroupBig Data and BI Tools - BI Reporting for Bay Area Startups User Group
Big Data and BI Tools - BI Reporting for Bay Area Startups User Group
 
BarbaraZigmanResume 2016
BarbaraZigmanResume 2016BarbaraZigmanResume 2016
BarbaraZigmanResume 2016
 
Resume quaish abuzer
Resume quaish abuzerResume quaish abuzer
Resume quaish abuzer
 
Feature Store as a Data Foundation for Machine Learning
Feature Store as a Data Foundation for Machine LearningFeature Store as a Data Foundation for Machine Learning
Feature Store as a Data Foundation for Machine Learning
 
Informatica basics for beginners | Informatica ppt
Informatica basics for beginners | Informatica pptInformatica basics for beginners | Informatica ppt
Informatica basics for beginners | Informatica ppt
 
Configuration Management and Deployment
Configuration Management and DeploymentConfiguration Management and Deployment
Configuration Management and Deployment
 
BIG DATA ANALYTICS MEANS “IN-DATABASE” ANALYTICS
BIG DATA ANALYTICS MEANS “IN-DATABASE” ANALYTICSBIG DATA ANALYTICS MEANS “IN-DATABASE” ANALYTICS
BIG DATA ANALYTICS MEANS “IN-DATABASE” ANALYTICS
 
ERP Data Migration Methodologies
ERP Data Migration MethodologiesERP Data Migration Methodologies
ERP Data Migration Methodologies
 

Similar to How to Efficiently Transform Non-Spatial Data using FME

Improve Data Exchange in Intergraph Using FME
Improve Data Exchange in Intergraph Using FMEImprove Data Exchange in Intergraph Using FME
Improve Data Exchange in Intergraph Using FMESafe Software
 
Mastering Geospatial Metadata with FME
Mastering Geospatial Metadata with FMEMastering Geospatial Metadata with FME
Mastering Geospatial Metadata with FMESafe Software
 
Managing data interoperability with FME
Managing data interoperability with FMEManaging data interoperability with FME
Managing data interoperability with FMEIMGS
 
Your Data Eco System and FME
Your Data Eco System and FMEYour Data Eco System and FME
Your Data Eco System and FMERaghavendran S
 
Turbocharging FME: How to Improve the Performance of Your FME Workspaces
Turbocharging FME: How to Improve the Performance of Your FME WorkspacesTurbocharging FME: How to Improve the Performance of Your FME Workspaces
Turbocharging FME: How to Improve the Performance of Your FME WorkspacesSafe Software
 
PostGIS 2.0 – How to Improve Interoperability using FME
PostGIS 2.0 – How to Improve Interoperability using FMEPostGIS 2.0 – How to Improve Interoperability using FME
PostGIS 2.0 – How to Improve Interoperability using FMESafe Software
 
MarkLofic Pecha Kucha
MarkLofic Pecha KuchaMarkLofic Pecha Kucha
MarkLofic Pecha KuchaMatt Turner
 
How to Slice ‘n Dice 10 Types of Data into Esri ArcGIS
How to Slice ‘n Dice 10 Types of Data into Esri ArcGISHow to Slice ‘n Dice 10 Types of Data into Esri ArcGIS
How to Slice ‘n Dice 10 Types of Data into Esri ArcGISSafe Software
 
FME 2022.0: Driving Data Decisions, Fueling Innovation
FME 2022.0: Driving Data Decisions, Fueling InnovationFME 2022.0: Driving Data Decisions, Fueling Innovation
FME 2022.0: Driving Data Decisions, Fueling InnovationSafe Software
 
Deep Dive into FME Desktop 2014
Deep Dive into FME Desktop 2014Deep Dive into FME Desktop 2014
Deep Dive into FME Desktop 2014Safe Software
 
Databases and FME: Improving Interoperability with Oracle, SQL Server, and Po...
Databases and FME: Improving Interoperability with Oracle, SQL Server, and Po...Databases and FME: Improving Interoperability with Oracle, SQL Server, and Po...
Databases and FME: Improving Interoperability with Oracle, SQL Server, and Po...Safe Software
 
Oracle Database -- How to Improve Interoperability using FME
Oracle Database -- How to Improve Interoperability using FME Oracle Database -- How to Improve Interoperability using FME
Oracle Database -- How to Improve Interoperability using FME Safe Software
 
Meet the FME Product Managers and Take Your Data to New Heights
Meet the FME Product Managers and Take Your Data to New HeightsMeet the FME Product Managers and Take Your Data to New Heights
Meet the FME Product Managers and Take Your Data to New HeightsSafe Software
 
Unveiling FME 2014 – A Live Event
Unveiling FME 2014 – A Live EventUnveiling FME 2014 – A Live Event
Unveiling FME 2014 – A Live EventSafe Software
 
GIS & Data Integration with ArcGIS and FME: Unleashing the Potential of Data-...
GIS & Data Integration with ArcGIS and FME: Unleashing the Potential of Data-...GIS & Data Integration with ArcGIS and FME: Unleashing the Potential of Data-...
GIS & Data Integration with ArcGIS and FME: Unleashing the Potential of Data-...Safe Software
 
GIS & Data Integration with ArcGIS and FME: Unleashing the Potential of Data-...
GIS & Data Integration with ArcGIS and FME: Unleashing the Potential of Data-...GIS & Data Integration with ArcGIS and FME: Unleashing the Potential of Data-...
GIS & Data Integration with ArcGIS and FME: Unleashing the Potential of Data-...Safe Software
 
Leveraging Data Integration for Strategic GIS Governance
Leveraging Data Integration for Strategic GIS GovernanceLeveraging Data Integration for Strategic GIS Governance
Leveraging Data Integration for Strategic GIS GovernanceSafe Software
 
Creating Commercial Data Products with FME
Creating Commercial Data Products with FMECreating Commercial Data Products with FME
Creating Commercial Data Products with FMESafe Software
 
Getting Started with Enterprise Integration in Automations
Getting Started with Enterprise Integration in AutomationsGetting Started with Enterprise Integration in Automations
Getting Started with Enterprise Integration in AutomationsSafe Software
 
Unlocking the Power of Your Data: Working with Databases in FME
Unlocking the Power of Your Data: Working with Databases in FMEUnlocking the Power of Your Data: Working with Databases in FME
Unlocking the Power of Your Data: Working with Databases in FMESafe Software
 

Similar to How to Efficiently Transform Non-Spatial Data using FME (20)

Improve Data Exchange in Intergraph Using FME
Improve Data Exchange in Intergraph Using FMEImprove Data Exchange in Intergraph Using FME
Improve Data Exchange in Intergraph Using FME
 
Mastering Geospatial Metadata with FME
Mastering Geospatial Metadata with FMEMastering Geospatial Metadata with FME
Mastering Geospatial Metadata with FME
 
Managing data interoperability with FME
Managing data interoperability with FMEManaging data interoperability with FME
Managing data interoperability with FME
 
Your Data Eco System and FME
Your Data Eco System and FMEYour Data Eco System and FME
Your Data Eco System and FME
 
Turbocharging FME: How to Improve the Performance of Your FME Workspaces
Turbocharging FME: How to Improve the Performance of Your FME WorkspacesTurbocharging FME: How to Improve the Performance of Your FME Workspaces
Turbocharging FME: How to Improve the Performance of Your FME Workspaces
 
PostGIS 2.0 – How to Improve Interoperability using FME
PostGIS 2.0 – How to Improve Interoperability using FMEPostGIS 2.0 – How to Improve Interoperability using FME
PostGIS 2.0 – How to Improve Interoperability using FME
 
MarkLofic Pecha Kucha
MarkLofic Pecha KuchaMarkLofic Pecha Kucha
MarkLofic Pecha Kucha
 
How to Slice ‘n Dice 10 Types of Data into Esri ArcGIS
How to Slice ‘n Dice 10 Types of Data into Esri ArcGISHow to Slice ‘n Dice 10 Types of Data into Esri ArcGIS
How to Slice ‘n Dice 10 Types of Data into Esri ArcGIS
 
FME 2022.0: Driving Data Decisions, Fueling Innovation
FME 2022.0: Driving Data Decisions, Fueling InnovationFME 2022.0: Driving Data Decisions, Fueling Innovation
FME 2022.0: Driving Data Decisions, Fueling Innovation
 
Deep Dive into FME Desktop 2014
Deep Dive into FME Desktop 2014Deep Dive into FME Desktop 2014
Deep Dive into FME Desktop 2014
 
Databases and FME: Improving Interoperability with Oracle, SQL Server, and Po...
Databases and FME: Improving Interoperability with Oracle, SQL Server, and Po...Databases and FME: Improving Interoperability with Oracle, SQL Server, and Po...
Databases and FME: Improving Interoperability with Oracle, SQL Server, and Po...
 
Oracle Database -- How to Improve Interoperability using FME
Oracle Database -- How to Improve Interoperability using FME Oracle Database -- How to Improve Interoperability using FME
Oracle Database -- How to Improve Interoperability using FME
 
Meet the FME Product Managers and Take Your Data to New Heights
Meet the FME Product Managers and Take Your Data to New HeightsMeet the FME Product Managers and Take Your Data to New Heights
Meet the FME Product Managers and Take Your Data to New Heights
 
Unveiling FME 2014 – A Live Event
Unveiling FME 2014 – A Live EventUnveiling FME 2014 – A Live Event
Unveiling FME 2014 – A Live Event
 
GIS & Data Integration with ArcGIS and FME: Unleashing the Potential of Data-...
GIS & Data Integration with ArcGIS and FME: Unleashing the Potential of Data-...GIS & Data Integration with ArcGIS and FME: Unleashing the Potential of Data-...
GIS & Data Integration with ArcGIS and FME: Unleashing the Potential of Data-...
 
GIS & Data Integration with ArcGIS and FME: Unleashing the Potential of Data-...
GIS & Data Integration with ArcGIS and FME: Unleashing the Potential of Data-...GIS & Data Integration with ArcGIS and FME: Unleashing the Potential of Data-...
GIS & Data Integration with ArcGIS and FME: Unleashing the Potential of Data-...
 
Leveraging Data Integration for Strategic GIS Governance
Leveraging Data Integration for Strategic GIS GovernanceLeveraging Data Integration for Strategic GIS Governance
Leveraging Data Integration for Strategic GIS Governance
 
Creating Commercial Data Products with FME
Creating Commercial Data Products with FMECreating Commercial Data Products with FME
Creating Commercial Data Products with FME
 
Getting Started with Enterprise Integration in Automations
Getting Started with Enterprise Integration in AutomationsGetting Started with Enterprise Integration in Automations
Getting Started with Enterprise Integration in Automations
 
Unlocking the Power of Your Data: Working with Databases in FME
Unlocking the Power of Your Data: Working with Databases in FMEUnlocking the Power of Your Data: Working with Databases in FME
Unlocking the Power of Your Data: Working with Databases in FME
 

More from Safe Software

From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action:  Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action:  Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsPowering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsSafe Software
 
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemThe Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemSafe Software
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsSafe Software
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightSafe Software
 
Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISSafe Software
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriGeospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriSafe Software
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfSafe Software
 
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologyBreaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologySafe Software
 
Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Safe Software
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software
 
New Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s FoundersNew Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s FoundersSafe Software
 
Taking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsTaking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsSafe Software
 
Initiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategyInitiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategySafe Software
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Safe Software
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...Safe Software
 
Mastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FMEMastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FMESafe Software
 

More from Safe Software (20)

From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action:  Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action:  Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsPowering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data Streams
 
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemThe Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data Ecosystem
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GIS
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriGeospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & Esri
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
 
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologyBreaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI Technology
 
Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
New Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s FoundersNew Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s Founders
 
Taking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsTaking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New Heights
 
Initiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategyInitiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance Strategy
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
 
Mastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FMEMastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FME
 

How to Efficiently Transform Non-Spatial Data using FME

  • 1. How to Efficiently Transform Non-Spatial Data using FME March 13, 2013
  • 2. Who Are We? Dale Lutz Co-Founder and Vice President of Development Safe Software Aaron Koning FME Server Product Manager Safe Software
  • 3. Guest Speakers  Daniel Riddle GIS Specialist for SYNCADD Systems Inc.  Kristofor Carle Software Developer for SYNCADD Systems Inc.
  • 4. Questions are Encouraged! This morning’s Q&A Support:  Mark Stoakes Manager Professional Services Safe Software  Iris Gutowski Product Support Specialist Safe Software
  • 5.
  • 6. FME – Feature Manipulation Engine Powering The Flow of Spatial Data
  • 7. FME – Feature Manipulation Engine Powering The Flow of Data
  • 8. FME Capabilities Transform Data to Use and Share  Convertspatial data between hundreds of formats  Transformspatial data into the precise data model you need  Integratemultiple different data types into a single data model  Sharespatial data with people where, when and how they need it
  • 10. New to FME?  Getting started page: http://fme.ly/GetStarted  Attend a weekly FME Desktop overview webinar: http://fme.ly/WeeklyIntro
  • 11. Poll: How much of your data is Non-Spatial?
  • 12. Why FME for Non-Spatial?  Beats Writing Code  Easier to maintain  Faster to configure  Powerful Transformations and Filtering  Supports Most Common Formats  Consistent Handling of Spatial and Non-Spatial in one tool
  • 16.
  • 17. Poll: What Non-Spatial Formats are of most interest to you?
  • 18. 1 - Old School Non-Spatial Egg Information (CAT) NEST_ID EGG_ID DATE_LAID DATE_HATCHED INCUBATION_DAYS 20 0 20040819 20040826 7 20 1 20040823 20040829 6 20 2 20040818 20040826 8 … Species (CSV) NestId,Species 100,BLUE JAY 101,AMERICAN GOLDFINCH …
  • 19. 1 - Old School Non-Spatial DEMO  Create a DBF file of:  Number of Eggs  Average Incubation  … for each species of bird
  • 20. 2 – The Office
  • 21. 2 – The Office
  • 22. 2 – The Office DEMO  Reorganize the Vancouver Business Licenses Excel File  Separate tabs for license state  Create summary tab  Flag errors into a new file
  • 26. 3 – Hipster DEMO  Check if my electric car needs charging  Read the Tesla Vehicle Webservice (which returns JSON)  Explode the JSON  Check if charging needed  Send email if yes  Honk horn if NO
  • 28. 4 – Corporate DEMO  Update Oracle with results from complex MS SQL Server query
  • 30. 5 – Cloudy DEMO  Publish data from SalesForce to Socrata  Filter out bad data along the way  Plus do schema restructuring for data sharing
  • 31. Guest Speakers  Daniel Riddle GIS Specialist for SYNCADD Systems Inc.  Kristofor Carle Software Developer for SYNCADD Systems Inc.
  • 32. Story 1: Data Upload Monitoring • The Mission: Monitor data uploaded via a web interface to an Army Geospatial Data Warehouse for compliance and data model validation, reporting the results. • The Solution: Use FME Server and custom transformers to run QA tests and email the results as Excel spreadsheets.
  • 33. SYNCADD • Custom transformers are created and source user parameters are published to leverage FME Server. • Readers Used: Schema; ESRI Personal, File, & SDE Geodatabase
  • 34. SYNCADD Custom transformers complete various tests on metadata tags, schema feature classes, and schema attributes.
  • 35. SYNCADD Results are exported as Microsoft Excel spreadsheets and emailed to the user using FME Server.
  • 36. Story 2: Non Spatial MS Access ETL • The Mission: Evaluate, document, and reproduce a non-spatial ETL process currently maintained in MS Access so that business experts (not just data analysts/DBAs) can understand it. • The Solution: Use FME to reorganize the process into diagrams in custom transformers. Add visual QA/QC checks directly into the workflow.
  • 37. SYNCADD • Before: SQL queries in MS Access
  • 38. SYNCADD • After: FME creates a diagram that is easy to understand.
  • 39. SYNCADD • Inspection points and FME Data Inspector make it easy to evaluate the process even on the fly in a meeting. • Visually compare link counts on printed diagrams after each data import to look for possible problems.
  • 41.
  • 42. Summary  Don’t let the Spatial scare you off!  FME is a powerful Non-Spatial problem solving machine  FME is not just for the desktop  FME Server is engineered for enterprise data transformation  Automate your non-spatial workflows
  • 43. 2013 FME World Tour!  40+ FME User Meetings happening world wide and one live stream  Register atwww.safe.com/worldtou r
  • 44. Upcoming webinars  How to Easily Read and Write CityGML Data Using FME – March 27  How to Load Spatial and Non-Spatial Data into Terdata using FME – April 3  PostGIS2.0 – How to Improve Interoperability using FME – April 24 Recorded Webinars:  http://fme.ly/webinars
  • 45. Poll: Would you like more information on our free training options?  View the offerings at:  http://fme.ly/online
  • 47. Thank You!  For more information, contact:  Sales  info@safe.com  Support  support@safe.com  (604)501-9985 ext. 278  Aaron  aaron.koning@safe.com  Dale  dal@safe.com  Daniel  daniel.riddle@syncadd.com  Kristofor  kristofor.carle@syncadd.com