SlideShare a Scribd company logo
CONNECT. TRANSFORM. AUTOMATE.
Using Safe FME to ETL Near Real-
Time Global Ship Tracking Geodata
Taylor Nicholls
Product Manager, exactEarth Ltd.
exactEarth Tracks Ships
CONNECT. TRANSFORM. AUTOMATE.
How Do We Track Ships?
CONNECT. TRANSFORM. AUTOMATE.
What Data is Collected?
!  NMEA v.4 Automatic Identification System (AIS)
CONNECT. TRANSFORM. AUTOMATE.
c:1376505330*5A!AIVDM,1,1,,B,15BVJ@001UImQG1i3cS:g`Vt1W3h,0*10
c:1376505331*5B!AIVDM,1,1,,B,13F;ER7Oh9ImjK3hFw10A1i008Bm,0*04
c:1376505332*58!AIVDM,1,1,,A,13EWsr000tIiR25h;oRSL2k206B<,0*64
c:1376505332*58!AIVDM,1,1,,B,34WN660viTG<dVcm<c7cG93000wh,0*6E
c:1376505333*59!AIVDM,1,1,,B,33F86P7P0Rq8;@uf>ucM3gw42C9C,0*60
c:1376505334*5E!AIVDM,1,1,,A,33F;ER7Oh9ImjK3hFw2P7Ai60200,0*43
MMSI	
   Msg	
  Type	
   Time	
   Channel	
   SOG	
   Longitude	
   La9tude	
  
355048000	
   1	
  20130814_183530	
   B	
   10.1	
   -­‐86.1752	
   -­‐26.1139	
  
224581000	
   1	
  20130814_183531	
   B	
   0.9	
   -­‐86.11695833	
   -­‐27.33439333	
  
224001000	
   1	
  20130814_183532	
   A	
   6	
   -­‐87.04671667	
   -­‐27.63795667	
  
309823000	
   3	
  20130814_183532	
   B	
   10	
   -­‐123.0554317	
   -­‐18.87781667	
  
224528000	
   3	
  20130814_183533	
   B	
   3.4	
   -­‐96.08101667	
   -­‐31.04867167	
  
224581000	
   3	
  20130814_183534	
   A	
   0.9	
   -­‐86.11695833	
   -­‐27.33438333	
  
How Much Data is Collected?
!  5,000,000 satellite and coastal messages / day
!  > 100,000 ships
CONNECT. TRANSFORM. AUTOMATE.
Customer Challenges &
Solution
!  TCP/IP data stream
!  NMEA v.4 binary format
!  Millions of messages
!  How to decode and transform
!  How to store and use data
!  Enter… FME 2014
!  Supports NMEA Automatic Identification System
(AIS Data)
CONNECT. TRANSFORM. AUTOMATE.
FME & AIS How-to 101
!  Connect
!  TCP/IP
!  Transform
!  AIS to 325 different formats
!  Automate
!  Workspace w/ WorkspaceRunner loops main
Workspace
!  … Repeat 5,000,000 times / day
CONNECT. TRANSFORM. AUTOMATE.
Demo
CONNECT. TRANSFORM. AUTOMATE.
Thank You!
!  Questions?
!  For more information:
!  Taylor Nicholls, taylor.nicholls@exactearth.com
!  exactEarth Limited
!  www.exactearth.com
CONNECT. TRANSFORM. AUTOMATE.

More Related Content

What's hot

hardware_design_RAFS
hardware_design_RAFShardware_design_RAFS
hardware_design_RAFS
Pedro Pablo Plazas
 
Copy of Sonosite Internship
Copy of Sonosite InternshipCopy of Sonosite Internship
Copy of Sonosite Internship
Kevin Schindler
 
Caption data limited ez tomas training guide
Caption data limited ez tomas training guideCaption data limited ez tomas training guide
Caption data limited ez tomas training guide
Caption Data Limited
 
FCC(Forward Coupling Converter) using PSpice
FCC(Forward Coupling Converter) using PSpiceFCC(Forward Coupling Converter) using PSpice
FCC(Forward Coupling Converter) using PSpice
Tsuyoshi Horigome
 
Caption data limited ez analyst training guide
Caption data limited ez analyst training guideCaption data limited ez analyst training guide
Caption data limited ez analyst training guide
Caption Data Limited
 
Cert Rio 2016
Cert Rio 2016Cert Rio 2016
Cert Rio 2016
Yvonne Pedersen
 
Algorithms and hardware designs for quadcopters
Algorithms and hardware designs for quadcoptersAlgorithms and hardware designs for quadcopters
Algorithms and hardware designs for quadcopters
Shipeng Xu
 
HEV-System Li-Ion Batteries Charger
HEV-System Li-Ion Batteries ChargerHEV-System Li-Ion Batteries Charger
HEV-System Li-Ion Batteries Charger
Tsuyoshi Horigome
 

What's hot (8)

hardware_design_RAFS
hardware_design_RAFShardware_design_RAFS
hardware_design_RAFS
 
Copy of Sonosite Internship
Copy of Sonosite InternshipCopy of Sonosite Internship
Copy of Sonosite Internship
 
Caption data limited ez tomas training guide
Caption data limited ez tomas training guideCaption data limited ez tomas training guide
Caption data limited ez tomas training guide
 
FCC(Forward Coupling Converter) using PSpice
FCC(Forward Coupling Converter) using PSpiceFCC(Forward Coupling Converter) using PSpice
FCC(Forward Coupling Converter) using PSpice
 
Caption data limited ez analyst training guide
Caption data limited ez analyst training guideCaption data limited ez analyst training guide
Caption data limited ez analyst training guide
 
Cert Rio 2016
Cert Rio 2016Cert Rio 2016
Cert Rio 2016
 
Algorithms and hardware designs for quadcopters
Algorithms and hardware designs for quadcoptersAlgorithms and hardware designs for quadcopters
Algorithms and hardware designs for quadcopters
 
HEV-System Li-Ion Batteries Charger
HEV-System Li-Ion Batteries ChargerHEV-System Li-Ion Batteries Charger
HEV-System Li-Ion Batteries Charger
 

Viewers also liked

Using Continuous Etl With Real Time Queries To Eliminate My Sql Bottlenecks
Using Continuous Etl With Real Time Queries To Eliminate My Sql BottlenecksUsing Continuous Etl With Real Time Queries To Eliminate My Sql Bottlenecks
Using Continuous Etl With Real Time Queries To Eliminate My Sql Bottlenecks
MySQLConference
 
High volume real time contiguous etl and audit
High volume real time contiguous etl and auditHigh volume real time contiguous etl and audit
High volume real time contiguous etl and audit
Remus Rusanu
 
ETL DW-RealTime
ETL DW-RealTimeETL DW-RealTime
ETL DW-RealTime
Adriano Patrick Cunha
 
kafka for db as postgres
kafka for db as postgreskafka for db as postgres
kafka for db as postgres
PivotalOpenSourceHub
 
Hand Coding ETL Scenarios and Challenges
Hand Coding ETL Scenarios and ChallengesHand Coding ETL Scenarios and Challenges
Hand Coding ETL Scenarios and Challenges
mark madsen
 
Real time ETL processing using Spark streaming
Real time ETL processing using Spark streamingReal time ETL processing using Spark streaming
Real time ETL processing using Spark streaming
datamantra
 
Introduction to Real-time data processing
Introduction to Real-time data processingIntroduction to Real-time data processing
Introduction to Real-time data processing
Yogi Devendra Vyavahare
 

Viewers also liked (7)

Using Continuous Etl With Real Time Queries To Eliminate My Sql Bottlenecks
Using Continuous Etl With Real Time Queries To Eliminate My Sql BottlenecksUsing Continuous Etl With Real Time Queries To Eliminate My Sql Bottlenecks
Using Continuous Etl With Real Time Queries To Eliminate My Sql Bottlenecks
 
High volume real time contiguous etl and audit
High volume real time contiguous etl and auditHigh volume real time contiguous etl and audit
High volume real time contiguous etl and audit
 
ETL DW-RealTime
ETL DW-RealTimeETL DW-RealTime
ETL DW-RealTime
 
kafka for db as postgres
kafka for db as postgreskafka for db as postgres
kafka for db as postgres
 
Hand Coding ETL Scenarios and Challenges
Hand Coding ETL Scenarios and ChallengesHand Coding ETL Scenarios and Challenges
Hand Coding ETL Scenarios and Challenges
 
Real time ETL processing using Spark streaming
Real time ETL processing using Spark streamingReal time ETL processing using Spark streaming
Real time ETL processing using Spark streaming
 
Introduction to Real-time data processing
Introduction to Real-time data processingIntroduction to Real-time data processing
Introduction to Real-time data processing
 

Similar to Processing Near Real-Time Global Vessel Data

US Patent 8,887,785
US Patent 8,887,785US Patent 8,887,785
US Patent 8,887,785
Mark Goth
 
Power flex400
Power flex400Power flex400
Power flex400
Trung Dang
 
WEG Contactors Oveload Relays
WEG Contactors Oveload RelaysWEG Contactors Oveload Relays
WEG Contactors Oveload Relays
Allan Bernardino
 
Television... Good or Bad?
Television... Good or Bad?Television... Good or Bad?
Television... Good or Bad?
cmdtx312
 
Dual Purpose Generator Set Maintenance Manual
Dual Purpose Generator Set Maintenance ManualDual Purpose Generator Set Maintenance Manual
Dual Purpose Generator Set Maintenance Manual
Rimsky Cheng
 
NXXGS LOG
NXXGS LOGNXXGS LOG
Andrew AL7NF-PSA
Andrew AL7NF-PSAAndrew AL7NF-PSA
Andrew AL7NF-PSA
savomir
 
Etrex basic
Etrex basicEtrex basic
Etrex basic
Pablo Salazar
 
14:05 Galassi - Update EuroCTO Registry
14:05 Galassi - Update EuroCTO Registry14:05 Galassi - Update EuroCTO Registry
14:05 Galassi - Update EuroCTO Registry
Euro CTO Club
 
Utvflex reeling cables
Utvflex reeling cablesUtvflex reeling cables
Utvflex reeling cables
Giuseppe Carnà
 
Original PNP Transistor 2SA2098 SA2098 2098 TO-220 New Sanyo
Original PNP Transistor 2SA2098 SA2098 2098 TO-220 New SanyoOriginal PNP Transistor 2SA2098 SA2098 2098 TO-220 New Sanyo
Original PNP Transistor 2SA2098 SA2098 2098 TO-220 New Sanyo
AUTHELECTRONIC
 
Andrew AL7DF-PSA
Andrew AL7DF-PSAAndrew AL7DF-PSA
Andrew AL7DF-PSA
savomir
 
TMI MOTOR 3512 1GZ
TMI MOTOR 3512 1GZTMI MOTOR 3512 1GZ
TMI MOTOR 3512 1GZ
Giovanny Bocanegra
 
A Framework for Robust Control of Uncertainty in Self-Adaptive Software Conn...
 A Framework for Robust Control of Uncertainty in Self-Adaptive Software Conn... A Framework for Robust Control of Uncertainty in Self-Adaptive Software Conn...
A Framework for Robust Control of Uncertainty in Self-Adaptive Software Conn...
Pooyan Jamshidi
 
Study and Analysis of ECG Signal using ADS1298RECG-FE Analog Front End Kit
Study and Analysis of ECG Signal using ADS1298RECG-FE Analog Front End KitStudy and Analysis of ECG Signal using ADS1298RECG-FE Analog Front End Kit
Study and Analysis of ECG Signal using ADS1298RECG-FE Analog Front End Kit
IRJET Journal
 
Hyosung 1800 ce-atm-machine-owners-manual
Hyosung 1800 ce-atm-machine-owners-manualHyosung 1800 ce-atm-machine-owners-manual
Hyosung 1800 ce-atm-machine-owners-manual
pdfshearing
 
Applied motion products ssm brochure
Applied motion products ssm brochureApplied motion products ssm brochure
Applied motion products ssm brochure
Electromate
 
Commscope-Andrew AL5NF-PSA
Commscope-Andrew AL5NF-PSACommscope-Andrew AL5NF-PSA
Commscope-Andrew AL5NF-PSA
savomir
 
Nodal Insights for Generation Owners and Modeling with AURORAxmp
Nodal Insights for Generation Owners and Modeling with AURORAxmpNodal Insights for Generation Owners and Modeling with AURORAxmp
Nodal Insights for Generation Owners and Modeling with AURORAxmp
EPIS Inc
 
Bathymetry ME Thesis
Bathymetry ME ThesisBathymetry ME Thesis
Bathymetry ME Thesis
Nathanaël Esnault
 

Similar to Processing Near Real-Time Global Vessel Data (20)

US Patent 8,887,785
US Patent 8,887,785US Patent 8,887,785
US Patent 8,887,785
 
Power flex400
Power flex400Power flex400
Power flex400
 
WEG Contactors Oveload Relays
WEG Contactors Oveload RelaysWEG Contactors Oveload Relays
WEG Contactors Oveload Relays
 
Television... Good or Bad?
Television... Good or Bad?Television... Good or Bad?
Television... Good or Bad?
 
Dual Purpose Generator Set Maintenance Manual
Dual Purpose Generator Set Maintenance ManualDual Purpose Generator Set Maintenance Manual
Dual Purpose Generator Set Maintenance Manual
 
NXXGS LOG
NXXGS LOGNXXGS LOG
NXXGS LOG
 
Andrew AL7NF-PSA
Andrew AL7NF-PSAAndrew AL7NF-PSA
Andrew AL7NF-PSA
 
Etrex basic
Etrex basicEtrex basic
Etrex basic
 
14:05 Galassi - Update EuroCTO Registry
14:05 Galassi - Update EuroCTO Registry14:05 Galassi - Update EuroCTO Registry
14:05 Galassi - Update EuroCTO Registry
 
Utvflex reeling cables
Utvflex reeling cablesUtvflex reeling cables
Utvflex reeling cables
 
Original PNP Transistor 2SA2098 SA2098 2098 TO-220 New Sanyo
Original PNP Transistor 2SA2098 SA2098 2098 TO-220 New SanyoOriginal PNP Transistor 2SA2098 SA2098 2098 TO-220 New Sanyo
Original PNP Transistor 2SA2098 SA2098 2098 TO-220 New Sanyo
 
Andrew AL7DF-PSA
Andrew AL7DF-PSAAndrew AL7DF-PSA
Andrew AL7DF-PSA
 
TMI MOTOR 3512 1GZ
TMI MOTOR 3512 1GZTMI MOTOR 3512 1GZ
TMI MOTOR 3512 1GZ
 
A Framework for Robust Control of Uncertainty in Self-Adaptive Software Conn...
 A Framework for Robust Control of Uncertainty in Self-Adaptive Software Conn... A Framework for Robust Control of Uncertainty in Self-Adaptive Software Conn...
A Framework for Robust Control of Uncertainty in Self-Adaptive Software Conn...
 
Study and Analysis of ECG Signal using ADS1298RECG-FE Analog Front End Kit
Study and Analysis of ECG Signal using ADS1298RECG-FE Analog Front End KitStudy and Analysis of ECG Signal using ADS1298RECG-FE Analog Front End Kit
Study and Analysis of ECG Signal using ADS1298RECG-FE Analog Front End Kit
 
Hyosung 1800 ce-atm-machine-owners-manual
Hyosung 1800 ce-atm-machine-owners-manualHyosung 1800 ce-atm-machine-owners-manual
Hyosung 1800 ce-atm-machine-owners-manual
 
Applied motion products ssm brochure
Applied motion products ssm brochureApplied motion products ssm brochure
Applied motion products ssm brochure
 
Commscope-Andrew AL5NF-PSA
Commscope-Andrew AL5NF-PSACommscope-Andrew AL5NF-PSA
Commscope-Andrew AL5NF-PSA
 
Nodal Insights for Generation Owners and Modeling with AURORAxmp
Nodal Insights for Generation Owners and Modeling with AURORAxmpNodal Insights for Generation Owners and Modeling with AURORAxmp
Nodal Insights for Generation Owners and Modeling with AURORAxmp
 
Bathymetry ME Thesis
Bathymetry ME ThesisBathymetry ME Thesis
Bathymetry ME Thesis
 

More from Safe Software

Essentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation ParametersEssentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation Parameters
Safe Software
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
Safe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
Safe Software
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action:  Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action:  Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
Safe Software
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Safe Software
 
Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsPowering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data Streams
Safe Software
 
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemThe Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data Ecosystem
Safe Software
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Safe Software
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Safe Software
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
Safe Software
 
Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GIS
Safe Software
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriGeospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Safe Software
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Safe Software
 
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologyBreaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Safe Software
 

More from Safe Software (20)

Essentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation ParametersEssentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation Parameters
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action:  Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action:  Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsPowering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data Streams
 
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemThe Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data Ecosystem
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GIS
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriGeospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & Esri
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
 
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologyBreaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI Technology
 

Recently uploaded

Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and BioinformaticiansBiomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Neo4j
 
The Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptxThe Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptx
operationspcvita
 
Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
panagenda
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
MichaelKnudsen27
 
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectorsConnector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
DianaGray10
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
ssuserfac0301
 
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
saastr
 
"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota
Fwdays
 
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
Edge AI and Vision Alliance
 
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Harnessing the Power of NLP and Knowledge Graphs for Opioid ResearchHarnessing the Power of NLP and Knowledge Graphs for Opioid Research
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Neo4j
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
Brandon Minnick, MBA
 
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
Jason Yip
 
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Digital Banking in the Cloud: How Citizens Bank Unlocked Their MainframeDigital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Precisely
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
AstuteBusiness
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Chart Kalyan
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
Zilliz
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
Jakub Marek
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
akankshawande
 
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge GraphGraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
Neo4j
 

Recently uploaded (20)

Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and BioinformaticiansBiomedical Knowledge Graphs for Data Scientists and Bioinformaticians
Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
 
The Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptxThe Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptx
 
Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024Northern Engraving | Nameplate Manufacturing Process - 2024
Northern Engraving | Nameplate Manufacturing Process - 2024
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
 
Nordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptxNordic Marketo Engage User Group_June 13_ 2024.pptx
Nordic Marketo Engage User Group_June 13_ 2024.pptx
 
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectorsConnector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
 
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
Deep Dive: AI-Powered Marketing to Get More Leads and Customers with HyperGro...
 
"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota
 
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
 
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
Harnessing the Power of NLP and Knowledge Graphs for Opioid ResearchHarnessing the Power of NLP and Knowledge Graphs for Opioid Research
Harnessing the Power of NLP and Knowledge Graphs for Opioid Research
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
 
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
 
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Digital Banking in the Cloud: How Citizens Bank Unlocked Their MainframeDigital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
Digital Banking in the Cloud: How Citizens Bank Unlocked Their Mainframe
 
Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |Astute Business Solutions | Oracle Cloud Partner |
Astute Business Solutions | Oracle Cloud Partner |
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
 
Generating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and MilvusGenerating privacy-protected synthetic data using Secludy and Milvus
Generating privacy-protected synthetic data using Secludy and Milvus
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
 
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge GraphGraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
GraphRAG for LifeSciences Hands-On with the Clinical Knowledge Graph
 

Processing Near Real-Time Global Vessel Data

  • 1. CONNECT. TRANSFORM. AUTOMATE. Using Safe FME to ETL Near Real- Time Global Ship Tracking Geodata Taylor Nicholls Product Manager, exactEarth Ltd.
  • 2. exactEarth Tracks Ships CONNECT. TRANSFORM. AUTOMATE.
  • 3. How Do We Track Ships? CONNECT. TRANSFORM. AUTOMATE.
  • 4. What Data is Collected? !  NMEA v.4 Automatic Identification System (AIS) CONNECT. TRANSFORM. AUTOMATE. c:1376505330*5A!AIVDM,1,1,,B,15BVJ@001UImQG1i3cS:g`Vt1W3h,0*10 c:1376505331*5B!AIVDM,1,1,,B,13F;ER7Oh9ImjK3hFw10A1i008Bm,0*04 c:1376505332*58!AIVDM,1,1,,A,13EWsr000tIiR25h;oRSL2k206B<,0*64 c:1376505332*58!AIVDM,1,1,,B,34WN660viTG<dVcm<c7cG93000wh,0*6E c:1376505333*59!AIVDM,1,1,,B,33F86P7P0Rq8;@uf>ucM3gw42C9C,0*60 c:1376505334*5E!AIVDM,1,1,,A,33F;ER7Oh9ImjK3hFw2P7Ai60200,0*43 MMSI   Msg  Type   Time   Channel   SOG   Longitude   La9tude   355048000   1  20130814_183530   B   10.1   -­‐86.1752   -­‐26.1139   224581000   1  20130814_183531   B   0.9   -­‐86.11695833   -­‐27.33439333   224001000   1  20130814_183532   A   6   -­‐87.04671667   -­‐27.63795667   309823000   3  20130814_183532   B   10   -­‐123.0554317   -­‐18.87781667   224528000   3  20130814_183533   B   3.4   -­‐96.08101667   -­‐31.04867167   224581000   3  20130814_183534   A   0.9   -­‐86.11695833   -­‐27.33438333  
  • 5. How Much Data is Collected? !  5,000,000 satellite and coastal messages / day !  > 100,000 ships CONNECT. TRANSFORM. AUTOMATE.
  • 6. Customer Challenges & Solution !  TCP/IP data stream !  NMEA v.4 binary format !  Millions of messages !  How to decode and transform !  How to store and use data !  Enter… FME 2014 !  Supports NMEA Automatic Identification System (AIS Data) CONNECT. TRANSFORM. AUTOMATE.
  • 7. FME & AIS How-to 101 !  Connect !  TCP/IP !  Transform !  AIS to 325 different formats !  Automate !  Workspace w/ WorkspaceRunner loops main Workspace !  … Repeat 5,000,000 times / day CONNECT. TRANSFORM. AUTOMATE.
  • 9. Thank You! !  Questions? !  For more information: !  Taylor Nicholls, taylor.nicholls@exactearth.com !  exactEarth Limited !  www.exactearth.com CONNECT. TRANSFORM. AUTOMATE.