SlideShare a Scribd company logo
CONNECT. TRANSFORM. AUTOMATE.
Getting From A to B with FME
Benjamin Quest
con terra GmbH
Abstract
!  Stadtwerke Münster was the first public transit authority in
Germany to publish their data to Google Transit and to enable
customers to easily find their best connection from one location to
another. The multimodal transport options are easily accessible on
any device including mobile phones. Stadtwerke Münster used
FME to transform timetables and bus route data form the existing
management systems into the General Transit Feed Specification
(GTFS) used by Google Transit. FME helped to proof and
harmonize the bus timetable data coming from heterogeneous
data sources within the transit authority. The next step in the very
near future will be the support of real time transit data delivery to
customers powered by FME.
Agenda
!  Destination
!  From A: Source Data
!  To B: Destination Schema
!  Quality Assurance
!  Some Obstacles
!  Herr Müller
!  Road Ahead
Client: Stadtwerke Münster
!  Contractor for electricity, heat and water
!  Local public transport agency
!  115.000 passengers per day
!  100.000 arrivals and departures per day
!  170 busses
!  400 km bus network
!  600 stations
!  18 bus routes + 6 night bus routes
!  16 taxi bus routes
Customer Information
!  Time tables at bus stations
!  Ticket and time table information
on website
!  Fahrgastinformationssystem FIS
!  Departure times at bus stops
!  Apps for Android and iOS
Destination
!  Promoting multimodal routing in the city of
Münster
!  Make Stadtwerke Münster the first public
transport agency on Google Transit in Germany
!  " Transform and transfer timetable information
to Google Transit
!  A typical FME challenge: Getting the data from
schema A to schema B
From A: Source Data
!  Multiple applications, databases and
files
!  Export formats on national VDV
standards but heterogeneous:
!  ASCII CSV (with/without header) or
XML
!  " Use of VDV DIVA exchange
format (DINO) based on CSV
To B: General Transit Feed
Specification (GTFS)
!  Open standard
!  ZIP archive with CSV files
!  GTFS real-time extension
!  Binary format
!  Specification discussion board
agency
routes
calendar
stop_times
trips
…
…
…
Quality Assurance I
!  QA with FME reviewing the data and during the
workspace design process
!  For example: completeness of data
!  Route names
!  Destination descriptions
!  Route geometry
!  Bus stop description (example: “entrance only”)
!  Taxi bus " bus on demand
Quality Assurance II
!  Using Google tools within FME
!  Python shutdown script
!  Creation of HTML report with Feed Validator
!  Creation of batch file with shortcut to Schedule
Viewer
Google Tools
Google Feed Validator Google Schedule Viewer
Obstacle I: Non or Almost Non
Spatial Data
!  ~600 bus stations
!  ~1200 bus stops, but
!  50 without location
!  200 located on the centerline of the street
!  300 located wrong
!  Solution
!  New survey with GISPAD, placing and controlling
using ArcMap and orthophotos
Obstacle II: “Stops_to_close”
Warnings
!  Bus stops with redundant representations in the
source database
!  One bus stop, but different identifiers for multiple
routes (bus, night bus, taxi bus)
!  Exactly same coordinates, sometimes discrepancy
in centimeter scale
!  FME solution: DuplicateRemover + FeatureMerger
(Duplicates) on coordinates rounded to meters
Obstacle III: Coordinate Offset
!  Source coordinate system: DINO
!  EPSG:31467 / DHDN GK Zone 3
!  Destination coordinate system: GTFS
!  EPSG:4326 / LL WGS84
!  Insufficient results with high precision
transformations BeTa2007_NTv2 and 7 parameter
!  5 meter offset
Obstacle III: Coordinate Offset
!  FME Solution: Implementing Google transformation
parameters in MyCoordSysDefs.fme
Default Transformation “Google” Transformation
Obstacle IV: Representation of
Stop Times
!  DINO (source database)
1.  Departure at 12:23 from station x
2.  Next stop in 60 seconds at station y
3.  Next stop in 120 seconds at station z
!  GTFS
1.  Stop at 12:23 at station x
2.  Stop at 12:24 at station y
3.  Stop at 12:26 at station z
12:23
+ 60 sec
+ 120 sec
12:23
12:24
12:26
FME Solution
!  Use of VariableSetter and VariableRetriever to
calculate the absolute time schedules for every
route
!  Less runtime than using FeatureMerger
Obstacle V: On Demand Taxi
Busses
!  A lot of stops with the
same departure time
!  GTFS doesn’t allow
identic departure
times on consecutive
stops
FME Solution
!  “Removing” redundant stop times
!  Sorter + VariableSetter and
VariableRetriever
Feed Publication
!  Google Transit Partner Portal
!  Publication of feed by partner
!  2 options
!  Upload of csv files
!  Feed via
(Secured) URL
!  Individual review
by Google at
1st upload
Google Transit Partner Portal
!  Visual route control by user
Project History
!  Final review and approval by Google in July 2012
!  Publication of German railway timetables in
August 2012
!  Go live in November 2012 as the first local public
transport agency in Germany together with City
of Munich
!  " Destination reached!
Herr Müller
!  Visiting Münster for the first time
!  Likes to go from the mainstation to Münster
castle
Road Ahead
!  Implementation of real route geometries
!  Implementation of GTFS real time
!  Real time departures and arrivals
!  Delays
!  Shifted or inactive stops (constructions)
!  Real time vehicle locations
Thank You!
!  For more information:
con terra GmbH
fme@conterra.de
Benjamin Quest
b.quest@conterra.de
@benjamin_quest
CONNECT. TRANSFORM. AUTOMATE.

More Related Content

What's hot

An open source multimodal journey planning system based on 'de facto' standards
An open source multimodal journey planning system based on 'de facto' standardsAn open source multimodal journey planning system based on 'de facto' standards
An open source multimodal journey planning system based on 'de facto' standards
Juangui Jordán
 
G2 Berman
G2 BermanG2 Berman
EWGAT
EWGATEWGAT
Tilemill gwu-wboykinm
Tilemill gwu-wboykinmTilemill gwu-wboykinm
Tilemill gwu-wboykinm
Bill Morris
 
COGS Capstone - Active Transportation
COGS Capstone - Active TransportationCOGS Capstone - Active Transportation
COGS Capstone - Active Transportation
Gabriel Solomon
 
Progress in Building Freight Flows & Network MKM 2008
Progress in Building Freight Flows & Network MKM 2008Progress in Building Freight Flows & Network MKM 2008
Progress in Building Freight Flows & Network MKM 2008
WJ
 
abstract
abstractabstract
abstract
Bertrand Masson
 
WebXpress GPS / Geo-fencing Capability
WebXpress GPS / Geo-fencing CapabilityWebXpress GPS / Geo-fencing Capability
WebXpress GPS / Geo-fencing Capability
WebXpress.IN
 
Mapc Data Day 7 15 09
Mapc Data Day 7 15 09Mapc Data Day 7 15 09
Mapc Data Day 7 15 09
aleda_freeman
 
Dynamic Fleet Sizing Problem for an E-Scooter Valet Service
Dynamic Fleet Sizing Problem for an E-Scooter Valet ServiceDynamic Fleet Sizing Problem for an E-Scooter Valet Service
Dynamic Fleet Sizing Problem for an E-Scooter Valet Service
Joseph Chow
 
Paratransit: Not 2nd Class Information
Paratransit: Not 2nd Class InformationParatransit: Not 2nd Class Information
Paratransit: Not 2nd Class Information
Aaron Antrim
 
Pipeline Routing Model A
Pipeline Routing Model APipeline Routing Model A
Pipeline Routing Model A
Andrew Zolnai
 
Report 4 jimenez
Report 4 jimenezReport 4 jimenez
Report 4 jimenez
Juan Jose Jimenez
 
Thompson & Alexander Dock Survey
Thompson & Alexander Dock SurveyThompson & Alexander Dock Survey
Thompson & Alexander Dock Survey
Ciara MacManus
 
Investigating Time-of-Use as a Factor in Dynamic Wireless Charging Infrastruc...
Investigating Time-of-Use as a Factor in Dynamic Wireless Charging Infrastruc...Investigating Time-of-Use as a Factor in Dynamic Wireless Charging Infrastruc...
Investigating Time-of-Use as a Factor in Dynamic Wireless Charging Infrastruc...
Joseph Chow
 
Linear scheduling LSM
Linear scheduling LSMLinear scheduling LSM
Linear scheduling LSM
Shaiful Amri Mansur
 
World pipeline tilos_article
World pipeline tilos_articleWorld pipeline tilos_article
World pipeline tilos_article
anamabbas01
 
Using FME and GTFS datasets to run TransitDatabase.com
Using FME and GTFS datasets to run TransitDatabase.comUsing FME and GTFS datasets to run TransitDatabase.com
Using FME and GTFS datasets to run TransitDatabase.com
Safe Software
 
Automating Transportation Feeds into ArcMap Products
Automating Transportation Feeds into ArcMap ProductsAutomating Transportation Feeds into ArcMap Products
Automating Transportation Feeds into ArcMap Products
Safe Software
 
Bus vanet
Bus vanetBus vanet
Bus vanet
jpstudcorner
 

What's hot (20)

An open source multimodal journey planning system based on 'de facto' standards
An open source multimodal journey planning system based on 'de facto' standardsAn open source multimodal journey planning system based on 'de facto' standards
An open source multimodal journey planning system based on 'de facto' standards
 
G2 Berman
G2 BermanG2 Berman
G2 Berman
 
EWGAT
EWGATEWGAT
EWGAT
 
Tilemill gwu-wboykinm
Tilemill gwu-wboykinmTilemill gwu-wboykinm
Tilemill gwu-wboykinm
 
COGS Capstone - Active Transportation
COGS Capstone - Active TransportationCOGS Capstone - Active Transportation
COGS Capstone - Active Transportation
 
Progress in Building Freight Flows & Network MKM 2008
Progress in Building Freight Flows & Network MKM 2008Progress in Building Freight Flows & Network MKM 2008
Progress in Building Freight Flows & Network MKM 2008
 
abstract
abstractabstract
abstract
 
WebXpress GPS / Geo-fencing Capability
WebXpress GPS / Geo-fencing CapabilityWebXpress GPS / Geo-fencing Capability
WebXpress GPS / Geo-fencing Capability
 
Mapc Data Day 7 15 09
Mapc Data Day 7 15 09Mapc Data Day 7 15 09
Mapc Data Day 7 15 09
 
Dynamic Fleet Sizing Problem for an E-Scooter Valet Service
Dynamic Fleet Sizing Problem for an E-Scooter Valet ServiceDynamic Fleet Sizing Problem for an E-Scooter Valet Service
Dynamic Fleet Sizing Problem for an E-Scooter Valet Service
 
Paratransit: Not 2nd Class Information
Paratransit: Not 2nd Class InformationParatransit: Not 2nd Class Information
Paratransit: Not 2nd Class Information
 
Pipeline Routing Model A
Pipeline Routing Model APipeline Routing Model A
Pipeline Routing Model A
 
Report 4 jimenez
Report 4 jimenezReport 4 jimenez
Report 4 jimenez
 
Thompson & Alexander Dock Survey
Thompson & Alexander Dock SurveyThompson & Alexander Dock Survey
Thompson & Alexander Dock Survey
 
Investigating Time-of-Use as a Factor in Dynamic Wireless Charging Infrastruc...
Investigating Time-of-Use as a Factor in Dynamic Wireless Charging Infrastruc...Investigating Time-of-Use as a Factor in Dynamic Wireless Charging Infrastruc...
Investigating Time-of-Use as a Factor in Dynamic Wireless Charging Infrastruc...
 
Linear scheduling LSM
Linear scheduling LSMLinear scheduling LSM
Linear scheduling LSM
 
World pipeline tilos_article
World pipeline tilos_articleWorld pipeline tilos_article
World pipeline tilos_article
 
Using FME and GTFS datasets to run TransitDatabase.com
Using FME and GTFS datasets to run TransitDatabase.comUsing FME and GTFS datasets to run TransitDatabase.com
Using FME and GTFS datasets to run TransitDatabase.com
 
Automating Transportation Feeds into ArcMap Products
Automating Transportation Feeds into ArcMap ProductsAutomating Transportation Feeds into ArcMap Products
Automating Transportation Feeds into ArcMap Products
 
Bus vanet
Bus vanetBus vanet
Bus vanet
 

Similar to Getting from A to B with FME

Food Truck Notification Service (Lightning Talk)
Food Truck Notification Service (Lightning Talk)Food Truck Notification Service (Lightning Talk)
Food Truck Notification Service (Lightning Talk)
Safe Software
 
TRAFI
TRAFITRAFI
Infrastructure Manager_EN_2015_zweiseitig
Infrastructure Manager_EN_2015_zweiseitigInfrastructure Manager_EN_2015_zweiseitig
Infrastructure Manager_EN_2015_zweiseitig
Kay Tewes
 
JGrass: The Horton Machine
JGrass: The Horton MachineJGrass: The Horton Machine
JGrass: The Horton Machine
Andrea Antonello
 
TransportCamp AU Presentation: Designing a multimodal, high-frequency network...
TransportCamp AU Presentation: Designing a multimodal, high-frequency network...TransportCamp AU Presentation: Designing a multimodal, high-frequency network...
TransportCamp AU Presentation: Designing a multimodal, high-frequency network...
Patrick Sunter
 
Ichiro Satoh
Ichiro SatohIchiro Satoh
Ichiro Satoh
Persuasive
 
VEBIMOBE
VEBIMOBEVEBIMOBE
VEBIMOBE
Peter Defreyne
 
SoTM US Routing
SoTM US RoutingSoTM US Routing
SoTM US Routing
MapQuest
 
N010428796
N010428796N010428796
N010428796
IOSR Journals
 
Routing
RoutingRouting
smartport logistik hamburg.pdf
smartport logistik hamburg.pdfsmartport logistik hamburg.pdf
smartport logistik hamburg.pdf
dedeakmal
 
WebXpress solutions TMS express cargo
WebXpress solutions TMS express cargoWebXpress solutions TMS express cargo
WebXpress solutions TMS express cargo
WebXpress.IN
 
DorogaTV cloud fleet management
DorogaTV cloud fleet managementDorogaTV cloud fleet management
DorogaTV cloud fleet management
Evgeni
 
Smart bus system pilot project (BUSKET)
Smart bus system pilot project (BUSKET)Smart bus system pilot project (BUSKET)
Smart bus system pilot project (BUSKET)
Minh S. Dao
 
Blu Fax Recent Advances 2 24 2011
Blu Fax Recent Advances 2 24 2011Blu Fax Recent Advances 2 24 2011
Blu Fax Recent Advances 2 24 2011
nelsondonnac
 
FME User Stories from Around the World
FME User Stories from Around the WorldFME User Stories from Around the World
FME User Stories from Around the World
Safe Software
 
Why don't we have REAL IP to the Edge in Buildings?
Why don't we have REAL IP to the Edge in Buildings?Why don't we have REAL IP to the Edge in Buildings?
Why don't we have REAL IP to the Edge in Buildings?
Memoori
 
FME Around the World
FME Around the WorldFME Around the World
FME Around the World
Safe Software
 
DSD-INT 2022 The visual way of working​ - Joling
DSD-INT 2022 The visual way of working​ - JolingDSD-INT 2022 The visual way of working​ - Joling
DSD-INT 2022 The visual way of working​ - Joling
Deltares
 
Measuring Bus and Bus-Passenger Travel by Road Segment
Measuring Bus and Bus-Passenger Travel by Road SegmentMeasuring Bus and Bus-Passenger Travel by Road Segment
Measuring Bus and Bus-Passenger Travel by Road Segment
Safe Software
 

Similar to Getting from A to B with FME (20)

Food Truck Notification Service (Lightning Talk)
Food Truck Notification Service (Lightning Talk)Food Truck Notification Service (Lightning Talk)
Food Truck Notification Service (Lightning Talk)
 
TRAFI
TRAFITRAFI
TRAFI
 
Infrastructure Manager_EN_2015_zweiseitig
Infrastructure Manager_EN_2015_zweiseitigInfrastructure Manager_EN_2015_zweiseitig
Infrastructure Manager_EN_2015_zweiseitig
 
JGrass: The Horton Machine
JGrass: The Horton MachineJGrass: The Horton Machine
JGrass: The Horton Machine
 
TransportCamp AU Presentation: Designing a multimodal, high-frequency network...
TransportCamp AU Presentation: Designing a multimodal, high-frequency network...TransportCamp AU Presentation: Designing a multimodal, high-frequency network...
TransportCamp AU Presentation: Designing a multimodal, high-frequency network...
 
Ichiro Satoh
Ichiro SatohIchiro Satoh
Ichiro Satoh
 
VEBIMOBE
VEBIMOBEVEBIMOBE
VEBIMOBE
 
SoTM US Routing
SoTM US RoutingSoTM US Routing
SoTM US Routing
 
N010428796
N010428796N010428796
N010428796
 
Routing
RoutingRouting
Routing
 
smartport logistik hamburg.pdf
smartport logistik hamburg.pdfsmartport logistik hamburg.pdf
smartport logistik hamburg.pdf
 
WebXpress solutions TMS express cargo
WebXpress solutions TMS express cargoWebXpress solutions TMS express cargo
WebXpress solutions TMS express cargo
 
DorogaTV cloud fleet management
DorogaTV cloud fleet managementDorogaTV cloud fleet management
DorogaTV cloud fleet management
 
Smart bus system pilot project (BUSKET)
Smart bus system pilot project (BUSKET)Smart bus system pilot project (BUSKET)
Smart bus system pilot project (BUSKET)
 
Blu Fax Recent Advances 2 24 2011
Blu Fax Recent Advances 2 24 2011Blu Fax Recent Advances 2 24 2011
Blu Fax Recent Advances 2 24 2011
 
FME User Stories from Around the World
FME User Stories from Around the WorldFME User Stories from Around the World
FME User Stories from Around the World
 
Why don't we have REAL IP to the Edge in Buildings?
Why don't we have REAL IP to the Edge in Buildings?Why don't we have REAL IP to the Edge in Buildings?
Why don't we have REAL IP to the Edge in Buildings?
 
FME Around the World
FME Around the WorldFME Around the World
FME Around the World
 
DSD-INT 2022 The visual way of working​ - Joling
DSD-INT 2022 The visual way of working​ - JolingDSD-INT 2022 The visual way of working​ - Joling
DSD-INT 2022 The visual way of working​ - Joling
 
Measuring Bus and Bus-Passenger Travel by Road Segment
Measuring Bus and Bus-Passenger Travel by Road SegmentMeasuring Bus and Bus-Passenger Travel by Road Segment
Measuring Bus and Bus-Passenger Travel by Road Segment
 

More from Safe Software

Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
Safe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
Safe Software
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action:  Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action:  Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
Safe Software
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Safe Software
 
Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsPowering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data Streams
Safe Software
 
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemThe Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data Ecosystem
Safe Software
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Safe Software
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Safe Software
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
Safe Software
 
Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GIS
Safe Software
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriGeospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Safe Software
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Safe Software
 
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologyBreaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Safe Software
 
Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...
Safe Software
 

More from Safe Software (20)

Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action:  Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action:  Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsPowering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data Streams
 
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemThe Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data Ecosystem
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GIS
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriGeospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & Esri
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
 
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologyBreaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI Technology
 
Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...
 

Recently uploaded

How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
Daiki Mogmet Ito
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
Ana-Maria Mihalceanu
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
Aftab Hussain
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
Uni Systems S.M.S.A.
 
20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website
Pixlogix Infotech
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
Neo4j
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Aggregage
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
sonjaschweigert1
 
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AIEnchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Vladimir Iglovikov, Ph.D.
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
Matthew Sinclair
 
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AIMind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
Kumud Singh
 
Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...
Zilliz
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
DianaGray10
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
Matthew Sinclair
 
Data structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdfData structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdf
TIPNGVN2
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
Adtran
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
innovationoecd
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems S.M.S.A.
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
danishmna97
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Malak Abu Hammad
 

Recently uploaded (20)

How to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For FlutterHow to use Firebase Data Connect For Flutter
How to use Firebase Data Connect For Flutter
 
Monitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR EventsMonitoring Java Application Security with JDK Tools and JFR Events
Monitoring Java Application Security with JDK Tools and JFR Events
 
Removing Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software FuzzingRemoving Uninteresting Bytes in Software Fuzzing
Removing Uninteresting Bytes in Software Fuzzing
 
Microsoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdfMicrosoft - Power Platform_G.Aspiotis.pdf
Microsoft - Power Platform_G.Aspiotis.pdf
 
20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website20 Comprehensive Checklist of Designing and Developing a Website
20 Comprehensive Checklist of Designing and Developing a Website
 
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
GraphSummit Singapore | Enhancing Changi Airport Group's Passenger Experience...
 
Generative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionGenerative AI Deep Dive: Advancing from Proof of Concept to Production
Generative AI Deep Dive: Advancing from Proof of Concept to Production
 
A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...A tale of scale & speed: How the US Navy is enabling software delivery from l...
A tale of scale & speed: How the US Navy is enabling software delivery from l...
 
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AIEnchancing adoption of Open Source Libraries. A case study on Albumentations.AI
Enchancing adoption of Open Source Libraries. A case study on Albumentations.AI
 
20240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 202420240609 QFM020 Irresponsible AI Reading List May 2024
20240609 QFM020 Irresponsible AI Reading List May 2024
 
Mind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AIMind map of terminologies used in context of Generative AI
Mind map of terminologies used in context of Generative AI
 
Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...Building RAG with self-deployed Milvus vector database and Snowpark Container...
Building RAG with self-deployed Milvus vector database and Snowpark Container...
 
UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6UiPath Test Automation using UiPath Test Suite series, part 6
UiPath Test Automation using UiPath Test Suite series, part 6
 
20240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 202420240605 QFM017 Machine Intelligence Reading List May 2024
20240605 QFM017 Machine Intelligence Reading List May 2024
 
Data structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdfData structures and Algorithms in Python.pdf
Data structures and Algorithms in Python.pdf
 
Pushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 daysPushing the limits of ePRTC: 100ns holdover for 100 days
Pushing the limits of ePRTC: 100ns holdover for 100 days
 
Presentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of GermanyPresentation of the OECD Artificial Intelligence Review of Germany
Presentation of the OECD Artificial Intelligence Review of Germany
 
Uni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdfUni Systems Copilot event_05062024_C.Vlachos.pdf
Uni Systems Copilot event_05062024_C.Vlachos.pdf
 
How to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptxHow to Get CNIC Information System with Paksim Ga.pptx
How to Get CNIC Information System with Paksim Ga.pptx
 
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdfUnlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
Unlock the Future of Search with MongoDB Atlas_ Vector Search Unleashed.pdf
 

Getting from A to B with FME

  • 1. CONNECT. TRANSFORM. AUTOMATE. Getting From A to B with FME Benjamin Quest con terra GmbH
  • 2. Abstract !  Stadtwerke Münster was the first public transit authority in Germany to publish their data to Google Transit and to enable customers to easily find their best connection from one location to another. The multimodal transport options are easily accessible on any device including mobile phones. Stadtwerke Münster used FME to transform timetables and bus route data form the existing management systems into the General Transit Feed Specification (GTFS) used by Google Transit. FME helped to proof and harmonize the bus timetable data coming from heterogeneous data sources within the transit authority. The next step in the very near future will be the support of real time transit data delivery to customers powered by FME.
  • 3. Agenda !  Destination !  From A: Source Data !  To B: Destination Schema !  Quality Assurance !  Some Obstacles !  Herr Müller !  Road Ahead
  • 4. Client: Stadtwerke Münster !  Contractor for electricity, heat and water !  Local public transport agency !  115.000 passengers per day !  100.000 arrivals and departures per day !  170 busses !  400 km bus network !  600 stations !  18 bus routes + 6 night bus routes !  16 taxi bus routes
  • 5. Customer Information !  Time tables at bus stations !  Ticket and time table information on website !  Fahrgastinformationssystem FIS !  Departure times at bus stops !  Apps for Android and iOS
  • 6. Destination !  Promoting multimodal routing in the city of Münster !  Make Stadtwerke Münster the first public transport agency on Google Transit in Germany !  " Transform and transfer timetable information to Google Transit !  A typical FME challenge: Getting the data from schema A to schema B
  • 7. From A: Source Data !  Multiple applications, databases and files !  Export formats on national VDV standards but heterogeneous: !  ASCII CSV (with/without header) or XML !  " Use of VDV DIVA exchange format (DINO) based on CSV
  • 8. To B: General Transit Feed Specification (GTFS) !  Open standard !  ZIP archive with CSV files !  GTFS real-time extension !  Binary format !  Specification discussion board agency routes calendar stop_times trips … … …
  • 9. Quality Assurance I !  QA with FME reviewing the data and during the workspace design process !  For example: completeness of data !  Route names !  Destination descriptions !  Route geometry !  Bus stop description (example: “entrance only”) !  Taxi bus " bus on demand
  • 10. Quality Assurance II !  Using Google tools within FME !  Python shutdown script !  Creation of HTML report with Feed Validator !  Creation of batch file with shortcut to Schedule Viewer
  • 11. Google Tools Google Feed Validator Google Schedule Viewer
  • 12. Obstacle I: Non or Almost Non Spatial Data !  ~600 bus stations !  ~1200 bus stops, but !  50 without location !  200 located on the centerline of the street !  300 located wrong !  Solution !  New survey with GISPAD, placing and controlling using ArcMap and orthophotos
  • 13. Obstacle II: “Stops_to_close” Warnings !  Bus stops with redundant representations in the source database !  One bus stop, but different identifiers for multiple routes (bus, night bus, taxi bus) !  Exactly same coordinates, sometimes discrepancy in centimeter scale !  FME solution: DuplicateRemover + FeatureMerger (Duplicates) on coordinates rounded to meters
  • 14. Obstacle III: Coordinate Offset !  Source coordinate system: DINO !  EPSG:31467 / DHDN GK Zone 3 !  Destination coordinate system: GTFS !  EPSG:4326 / LL WGS84 !  Insufficient results with high precision transformations BeTa2007_NTv2 and 7 parameter !  5 meter offset
  • 15. Obstacle III: Coordinate Offset !  FME Solution: Implementing Google transformation parameters in MyCoordSysDefs.fme Default Transformation “Google” Transformation
  • 16. Obstacle IV: Representation of Stop Times !  DINO (source database) 1.  Departure at 12:23 from station x 2.  Next stop in 60 seconds at station y 3.  Next stop in 120 seconds at station z !  GTFS 1.  Stop at 12:23 at station x 2.  Stop at 12:24 at station y 3.  Stop at 12:26 at station z 12:23 + 60 sec + 120 sec 12:23 12:24 12:26
  • 17. FME Solution !  Use of VariableSetter and VariableRetriever to calculate the absolute time schedules for every route !  Less runtime than using FeatureMerger
  • 18. Obstacle V: On Demand Taxi Busses !  A lot of stops with the same departure time !  GTFS doesn’t allow identic departure times on consecutive stops
  • 19. FME Solution !  “Removing” redundant stop times !  Sorter + VariableSetter and VariableRetriever
  • 20. Feed Publication !  Google Transit Partner Portal !  Publication of feed by partner !  2 options !  Upload of csv files !  Feed via (Secured) URL !  Individual review by Google at 1st upload
  • 21. Google Transit Partner Portal !  Visual route control by user
  • 22. Project History !  Final review and approval by Google in July 2012 !  Publication of German railway timetables in August 2012 !  Go live in November 2012 as the first local public transport agency in Germany together with City of Munich !  " Destination reached!
  • 23. Herr Müller !  Visiting Münster for the first time !  Likes to go from the mainstation to Münster castle
  • 24. Road Ahead !  Implementation of real route geometries !  Implementation of GTFS real time !  Real time departures and arrivals !  Delays !  Shifted or inactive stops (constructions) !  Real time vehicle locations
  • 25. Thank You! !  For more information: con terra GmbH fme@conterra.de Benjamin Quest b.quest@conterra.de @benjamin_quest CONNECT. TRANSFORM. AUTOMATE.