SlideShare a Scribd company logo
DATA-DRIVEN VESSEL SERVICE TIME FORECASTING USING LONG
SHORT-TERM MEMORY RECURRENT NEURAL NETWORKS
Ibrahim AbuAlhaol, Rafael Falcon, Rami Abielmona, and Emil Petriu
Project : Big Data Analytics for the Maritime Internet of Things
Funding: NSERC CRD 499024-16, Ontario Centres of Excellence (OCE) , Larus Technologies
Motivation
12/11/18 2
‣ Maritime Port congestion causes delay
in the shipping services which results
in financial and reputation losses.
‣ Disruption management mitigates the
impact of disruption events but
requires data-driven insights to
evaluate the disruption.
‣ Can we model and forecast average
Vessel Service Time by using
Automatic Identification System (AIS)?
Contributions
12/11/18 3
‣ Spatiotemporal mining
algorithms to calculate
Convex hull area,
Geohash area, and
vessels proximity.
‣ Analytical formulation of two Port Congestion Indicators (PCIs) to
capture port spatial complexity and spatial density.
‣ AIS-based mining algorithm to estimate average Vessel Service Time.
‣ LSTM-based model to forecast average Vessel Service Time.
12/11/18 4
‣ Reliable shipping services is an important challenge for maritime port
authorities and liner shipping companies.
‣ Regular uncertainties (e.g., port productivity) and disruptions (e.g., weather
conditions) are main factors that affect the quality of maritime port services.
‣ Port authorities need to mitigate disruption by considering all possible causes
and appropriate countermeasures.
‣ We propose data-driven Port Congestion Indicators (PCIs) and Average Vessel
Service Time forecasting model to provide actionable insights to port authority
operation managers and other stakeholders (liner shipping companies)
‣ Seaborne trade is estimated to have 90% of
the volume of global trade and therefore
maritime port performance and resilience is
crucial in sustaining global economic growth.
Connecting the dots!
Data: Automatic Identification System (AIS)
12/11/18
* Draught of a ship’s hull is the vertical distance
between the waterline and the bottom of the hull.
‣ AIS is a vessel tracking system
that provides regular updates
on a vessel’s movement and
other relevant ship voyage
data to other parties.
‣ Static and Dynamic vessel
information can be
electronically exchanged
between AIS-receiving
stations (on board, ashore or
satellite). *
Big Data characteristic of AIS
12/11/18 6
‣ Volume: The AIS data is big in volume where
one year of Terrestrial data is around 1
Terabyte.
‣ Velocity: AIS dynamic messages are broadcast
at different time intervals depending on the
vessel’s speed and rate of turn (from 2 seconds
to 3 minutes).
‣ Veracity: Some of the fields in an AIS message could be either left outdated
or intentionally spoofed.
‣ Variety: AIS messages report different data types (e.g., Destination is text
whereas Maritime Mobile Service Identity (MMSI) is an integer).
Area of Interest [Port of Singapore]
12/11/18 7
Convex Hull Area
Geohash Area
12/11/18 8
Geohash precision and cell height/width
‣ Geohash is a geocoding system encodes a geographic
location into a short string of letters and digits.
‣ We used precision-7 (PREC = 7 ) geohashes which divides the
Area of Interest into 153m x 153m cells.
Geohash Area
AIS Data mining Framework
12/11/18 9
The Framework is composed of
• Cassandra for the consumption of AIS data,
• Spark for mining and extracting, and
• TensorFlow for LSTM modeling and forecasting.
Spatiotemporal Data Mining
12/11/18 10
‣ Convex Hull Area (ConvArea): The port
convex hull area is defined as the area
that encloses all vessels in the smallest
perimeter fence.
‣ Geohash Area (GeoArea):
Geohash is a geocoding system which
encodes a geographic location into a
short string of letters and digits.
Geohash area with precsion-7 is the
sum of all blue squares shown in the
figure.
Convex hull and precision-7 geohashes for Port
of Hong Kong in July 2015 (ShipT ype : 70 - 79,
ShipSpeed <= 5 knots, ConvArea = 63.55 Km2
,
GeoArea = 4.28 Km2).
‣ Average Vessel Proximity (D ): The average distance between the
locations of all vessels that are reported as either “Anchored” or
“Moored” and have a speed less than a predefined threshold.
12/11/18 11
12/11/18 12
12/11/18 13
12/11/18 14
Port Congestion Indicators (PCI) [1/2]
12/11/18 15
‣ Spatial Complexity (SpComplexity): is calculated after mining the convex
hull area (ConvArea) and the average vessel proximity (D ) as presented in
Algorithm 1 and Algorithm 3.
• i is the hour index from all hours (I) in January and February of 2018.
• G(i) denotes the number of unique geohashes at the ith aggregation period.
Port Congestion Indicators (PCI) [2/2]
12/11/18 16
‣ Spatial Density (SpDensity) calculated after mining the convex hull area
(ConvArea) and the Geohash area (GeoArea) as presented in Algorithm 1
and Algorithm 2.
• i is the hour index from all hours (I) in January and February of 2018.
Time series visualization with one hour aggregation
12/11/18 17
Average VST auto-correlation
12/11/18 18
Cross-correlation analysis
12/11/18 19
LSTM with dense layer architecture to forecast Average VST
12/11/18 20
‣ Lag Features: Current and past VST, spatiotemporal characteristics (i.e., ConvArea ,
GeotoArea , !), and congestion indicators (i.e., SpComplexity and SpDensity ).
k = 0; 1; 2; 3; 4 in the current (i.e., k=0) and the
past four aggregation periods (k = 4, is
selected after trying many possible lags).
K=0K=1K=2K=3
K=4
Architecture parameters and MSE Performance
12/11/18 21
We ran each experiment 50 times
and provided the 95% confidence
intervals.
12/11/18 22
LSTM Models Performance with
different time granularities
Summary and Conclusion
12/11/18 23
‣ The mined ConvArea and GeoArea were negatively correlated with
average VST which aligns with the fact that a larger area reduces the
congestion and therefore decreases average VST values.
‣ SpComplexity, SpDensity , and ! were positively correlated with
average VST ; this corroborates the fact that smaller values of these
congestion indicators lead to low average VST values.
‣ The results provides an empirical evidence of the practicality of using
LSTM Recurrent Neural Networks to model and forecast average VST
using current/past spatiotemporal characteristics and congestion
indicators mined from AIS data.
Limitations and Future Work
12/11/18 24
‣ One necessary extension of this work is to train and validate the
models on more AIS data.
‣ Investigate the model on several time and geohash granularities.
‣ The LSTM architecture could be enhanced by adding more layers
or/and incorporating more lags.
‣ Investigate advanced LSTM architectures such as
§ Bi-directional LSTM
§ Stacked LSTM
12/11/18 25
Questions and Feedback!

More Related Content

What's hot

JIP CRYTRANSFER external
JIP CRYTRANSFER externalJIP CRYTRANSFER external
JIP CRYTRANSFER external
Bas Van Den Beemt
 
Ports & Navigation: Optimise Operability and Reduce Dredging Costs 20-50% wit...
Ports & Navigation: Optimise Operability and Reduce Dredging Costs 20-50% wit...Ports & Navigation: Optimise Operability and Reduce Dredging Costs 20-50% wit...
Ports & Navigation: Optimise Operability and Reduce Dredging Costs 20-50% wit...
Stephen Flood
 
Navy: Hangar One Detailed Cost Estimate
Navy: Hangar One Detailed Cost EstimateNavy: Hangar One Detailed Cost Estimate
Navy: Hangar One Detailed Cost Estimate
Steve Williams
 
Decision support system for petrobras ship scheduling
Decision support system for petrobras ship schedulingDecision support system for petrobras ship scheduling
Decision support system for petrobras ship scheduling
Jiayu Chen
 
DSD-INT 2017 River Basin Simulation Model RIBASIM Developments - Van der Krogt
DSD-INT 2017 River Basin Simulation Model RIBASIM Developments - Van der KrogtDSD-INT 2017 River Basin Simulation Model RIBASIM Developments - Van der Krogt
DSD-INT 2017 River Basin Simulation Model RIBASIM Developments - Van der Krogt
Deltares
 
Portunus webinar: Floating port technologies could revolutionize container co...
Portunus webinar: Floating port technologies could revolutionize container co...Portunus webinar: Floating port technologies could revolutionize container co...
Portunus webinar: Floating port technologies could revolutionize container co...
Lawrence Livermore National Laboratory
 
Port Congestion John Heylan
Port Congestion John HeylanPort Congestion John Heylan
Port Congestion John Heylan
Canada Cruise
 
Seca seminar 2013 wilh wilhelmsen - per brinchmann
Seca seminar 2013   wilh wilhelmsen - per brinchmannSeca seminar 2013   wilh wilhelmsen - per brinchmann
Seca seminar 2013 wilh wilhelmsen - per brinchmann
Shortsea Promotion Centre Norway
 
DSD-NL 2014 - NGHS Flexible Mesh - Optimizing harbour maintenance strategies ...
DSD-NL 2014 - NGHS Flexible Mesh - Optimizing harbour maintenance strategies ...DSD-NL 2014 - NGHS Flexible Mesh - Optimizing harbour maintenance strategies ...
DSD-NL 2014 - NGHS Flexible Mesh - Optimizing harbour maintenance strategies ...
Deltares
 
PORT & DESTINATION ASSOCIATION DEVELOPMENT • Bo Larsen, Director Cruise Balt...
PORT & DESTINATION ASSOCIATION DEVELOPMENT 	• Bo Larsen, Director Cruise Balt...PORT & DESTINATION ASSOCIATION DEVELOPMENT 	• Bo Larsen, Director Cruise Balt...
PORT & DESTINATION ASSOCIATION DEVELOPMENT • Bo Larsen, Director Cruise Balt...
CruisesNews Media Group
 
Vessel Operations Cooperative Solutions by Erik Vvanem
Vessel Operations Cooperative Solutions by Erik VvanemVessel Operations Cooperative Solutions by Erik Vvanem
Vessel Operations Cooperative Solutions by Erik Vvanem
Yannis Koliousis
 
FSRU Technology & Project Development
FSRU Technology & Project DevelopmentFSRU Technology & Project Development
FSRU Technology & Project Development
Walter Lee
 
Technology and service levels
Technology and service levelsTechnology and service levels
Technology and service levels
Tristan Wiggill
 
Focus towards nnelp 2
Focus towards nnelp 2Focus towards nnelp 2
Focus towards nnelp 2
SYED NAWAZ
 
velocityatlas
velocityatlasvelocityatlas
Presentation at IFOMC 2018
Presentation at IFOMC 2018Presentation at IFOMC 2018
Presentation at IFOMC 2018
Edvin Fuglebakk
 
CIM 2015 (Michael Spleit, New Millennium Iron)
CIM 2015 (Michael Spleit, New Millennium Iron)CIM 2015 (Michael Spleit, New Millennium Iron)
CIM 2015 (Michael Spleit, New Millennium Iron)
Michael Spleit
 
Global Container Pooling Sept 2009
Global Container Pooling   Sept 2009Global Container Pooling   Sept 2009
Global Container Pooling Sept 2009
rab2020
 
Probabilisitc analysis of marine fuels in emission controlled areas
Probabilisitc analysis of marine fuels in emission controlled areasProbabilisitc analysis of marine fuels in emission controlled areas
Probabilisitc analysis of marine fuels in emission controlled areas
Kamal Kannan
 
Container Inventory Management: Factors influencing Container Interchange
Container Inventory Management: Factors influencing Container InterchangeContainer Inventory Management: Factors influencing Container Interchange
Container Inventory Management: Factors influencing Container Interchange
CINEC Campus
 

What's hot (20)

JIP CRYTRANSFER external
JIP CRYTRANSFER externalJIP CRYTRANSFER external
JIP CRYTRANSFER external
 
Ports & Navigation: Optimise Operability and Reduce Dredging Costs 20-50% wit...
Ports & Navigation: Optimise Operability and Reduce Dredging Costs 20-50% wit...Ports & Navigation: Optimise Operability and Reduce Dredging Costs 20-50% wit...
Ports & Navigation: Optimise Operability and Reduce Dredging Costs 20-50% wit...
 
Navy: Hangar One Detailed Cost Estimate
Navy: Hangar One Detailed Cost EstimateNavy: Hangar One Detailed Cost Estimate
Navy: Hangar One Detailed Cost Estimate
 
Decision support system for petrobras ship scheduling
Decision support system for petrobras ship schedulingDecision support system for petrobras ship scheduling
Decision support system for petrobras ship scheduling
 
DSD-INT 2017 River Basin Simulation Model RIBASIM Developments - Van der Krogt
DSD-INT 2017 River Basin Simulation Model RIBASIM Developments - Van der KrogtDSD-INT 2017 River Basin Simulation Model RIBASIM Developments - Van der Krogt
DSD-INT 2017 River Basin Simulation Model RIBASIM Developments - Van der Krogt
 
Portunus webinar: Floating port technologies could revolutionize container co...
Portunus webinar: Floating port technologies could revolutionize container co...Portunus webinar: Floating port technologies could revolutionize container co...
Portunus webinar: Floating port technologies could revolutionize container co...
 
Port Congestion John Heylan
Port Congestion John HeylanPort Congestion John Heylan
Port Congestion John Heylan
 
Seca seminar 2013 wilh wilhelmsen - per brinchmann
Seca seminar 2013   wilh wilhelmsen - per brinchmannSeca seminar 2013   wilh wilhelmsen - per brinchmann
Seca seminar 2013 wilh wilhelmsen - per brinchmann
 
DSD-NL 2014 - NGHS Flexible Mesh - Optimizing harbour maintenance strategies ...
DSD-NL 2014 - NGHS Flexible Mesh - Optimizing harbour maintenance strategies ...DSD-NL 2014 - NGHS Flexible Mesh - Optimizing harbour maintenance strategies ...
DSD-NL 2014 - NGHS Flexible Mesh - Optimizing harbour maintenance strategies ...
 
PORT & DESTINATION ASSOCIATION DEVELOPMENT • Bo Larsen, Director Cruise Balt...
PORT & DESTINATION ASSOCIATION DEVELOPMENT 	• Bo Larsen, Director Cruise Balt...PORT & DESTINATION ASSOCIATION DEVELOPMENT 	• Bo Larsen, Director Cruise Balt...
PORT & DESTINATION ASSOCIATION DEVELOPMENT • Bo Larsen, Director Cruise Balt...
 
Vessel Operations Cooperative Solutions by Erik Vvanem
Vessel Operations Cooperative Solutions by Erik VvanemVessel Operations Cooperative Solutions by Erik Vvanem
Vessel Operations Cooperative Solutions by Erik Vvanem
 
FSRU Technology & Project Development
FSRU Technology & Project DevelopmentFSRU Technology & Project Development
FSRU Technology & Project Development
 
Technology and service levels
Technology and service levelsTechnology and service levels
Technology and service levels
 
Focus towards nnelp 2
Focus towards nnelp 2Focus towards nnelp 2
Focus towards nnelp 2
 
velocityatlas
velocityatlasvelocityatlas
velocityatlas
 
Presentation at IFOMC 2018
Presentation at IFOMC 2018Presentation at IFOMC 2018
Presentation at IFOMC 2018
 
CIM 2015 (Michael Spleit, New Millennium Iron)
CIM 2015 (Michael Spleit, New Millennium Iron)CIM 2015 (Michael Spleit, New Millennium Iron)
CIM 2015 (Michael Spleit, New Millennium Iron)
 
Global Container Pooling Sept 2009
Global Container Pooling   Sept 2009Global Container Pooling   Sept 2009
Global Container Pooling Sept 2009
 
Probabilisitc analysis of marine fuels in emission controlled areas
Probabilisitc analysis of marine fuels in emission controlled areasProbabilisitc analysis of marine fuels in emission controlled areas
Probabilisitc analysis of marine fuels in emission controlled areas
 
Container Inventory Management: Factors influencing Container Interchange
Container Inventory Management: Factors influencing Container InterchangeContainer Inventory Management: Factors influencing Container Interchange
Container Inventory Management: Factors influencing Container Interchange
 

Similar to Bd 2018 ibrahim

Analysis and Design of Marine Berthing Structure
Analysis and Design of Marine Berthing StructureAnalysis and Design of Marine Berthing Structure
Analysis and Design of Marine Berthing Structure
IJERA Editor
 
Smart ports: towards a high performance, increased productivity, and a bette...
Smart ports: towards a high performance, increased  productivity, and a bette...Smart ports: towards a high performance, increased  productivity, and a bette...
Smart ports: towards a high performance, increased productivity, and a bette...
IJECEIAES
 
ECDIS: New standards & old underwater rocks
ECDIS: New standards & old underwater rocksECDIS: New standards & old underwater rocks
ECDIS: New standards & old underwater rocks
Learnmarine
 
75346996 a-is
75346996 a-is75346996 a-is
75346996 a-is
Dheeraj Kaushal
 
Nav 6 power point presentation
Nav 6 power point presentationNav 6 power point presentation
Nav 6 power point presentation
Jayson Genobiagon
 
A wave piercing catamaran ferry
A wave piercing catamaran ferryA wave piercing catamaran ferry
A wave piercing catamaran ferry
KARIM KOTB
 
IRJET- Study on Different Estimation Methods of Propulsion Power for 60 Mts O...
IRJET- Study on Different Estimation Methods of Propulsion Power for 60 Mts O...IRJET- Study on Different Estimation Methods of Propulsion Power for 60 Mts O...
IRJET- Study on Different Estimation Methods of Propulsion Power for 60 Mts O...
IRJET Journal
 
Automatic-identification system gr1.pptx
Automatic-identification system gr1.pptxAutomatic-identification system gr1.pptx
Automatic-identification system gr1.pptx
MarkFrenlyLompot
 
Optimal routing development based on real voyage data presented by_sewonkim
Optimal  routing  development based on real voyage  data presented by_sewonkimOptimal  routing  development based on real voyage  data presented by_sewonkim
Optimal routing development based on real voyage data presented by_sewonkim
SEWON KIM
 
DSD-INT 2018 From global to local: Volvo Ocean Race 2018 - Minns
DSD-INT 2018 From global to local: Volvo Ocean Race 2018 - MinnsDSD-INT 2018 From global to local: Volvo Ocean Race 2018 - Minns
DSD-INT 2018 From global to local: Volvo Ocean Race 2018 - Minns
Deltares
 
Embedding Risk in Everything we do
Embedding Risk in Everything we doEmbedding Risk in Everything we do
Embedding Risk in Everything we do
Risk Management Institution of Australasia
 
IRJET- Preliminary Design of Floating Dry Dock
IRJET- Preliminary Design of Floating Dry DockIRJET- Preliminary Design of Floating Dry Dock
IRJET- Preliminary Design of Floating Dry Dock
IRJET Journal
 
Dissemination workshop-v2.1
Dissemination workshop-v2.1Dissemination workshop-v2.1
Dissemination workshop-v2.1
Gérald Morales
 
2010
 2010 2010
2010
HaqueNawaz
 
Aspng 2016_RTG hydro paper
Aspng 2016_RTG hydro paperAspng 2016_RTG hydro paper
Aspng 2016_RTG hydro paper
Derek Hayne Petrus
 
Container Terminal study
Container Terminal studyContainer Terminal study
Container Terminal study
Sumit Sharma
 
TGS GPS- Post Well Analysis - mid Norway
TGS GPS- Post Well Analysis - mid Norway TGS GPS- Post Well Analysis - mid Norway
TGS GPS- Post Well Analysis - mid Norway
TGS
 
Reservoir connectivity analysis_with_streamline_sim_nov_2010_v2
Reservoir connectivity analysis_with_streamline_sim_nov_2010_v2Reservoir connectivity analysis_with_streamline_sim_nov_2010_v2
Reservoir connectivity analysis_with_streamline_sim_nov_2010_v2
Arif Khan
 
SELECTION OF DRY PORT LOCATION FOR COSCO SHIPPING LINE GHANA COMPANY LIMITED ...
SELECTION OF DRY PORT LOCATION FOR COSCO SHIPPING LINE GHANA COMPANY LIMITED ...SELECTION OF DRY PORT LOCATION FOR COSCO SHIPPING LINE GHANA COMPANY LIMITED ...
SELECTION OF DRY PORT LOCATION FOR COSCO SHIPPING LINE GHANA COMPANY LIMITED ...
AkashSharma618775
 
REQUEST FOR PROPOSAL PROCEDURES
REQUEST FOR PROPOSAL PROCEDURESREQUEST FOR PROPOSAL PROCEDURES
REQUEST FOR PROPOSAL PROCEDURES
butest
 

Similar to Bd 2018 ibrahim (20)

Analysis and Design of Marine Berthing Structure
Analysis and Design of Marine Berthing StructureAnalysis and Design of Marine Berthing Structure
Analysis and Design of Marine Berthing Structure
 
Smart ports: towards a high performance, increased productivity, and a bette...
Smart ports: towards a high performance, increased  productivity, and a bette...Smart ports: towards a high performance, increased  productivity, and a bette...
Smart ports: towards a high performance, increased productivity, and a bette...
 
ECDIS: New standards & old underwater rocks
ECDIS: New standards & old underwater rocksECDIS: New standards & old underwater rocks
ECDIS: New standards & old underwater rocks
 
75346996 a-is
75346996 a-is75346996 a-is
75346996 a-is
 
Nav 6 power point presentation
Nav 6 power point presentationNav 6 power point presentation
Nav 6 power point presentation
 
A wave piercing catamaran ferry
A wave piercing catamaran ferryA wave piercing catamaran ferry
A wave piercing catamaran ferry
 
IRJET- Study on Different Estimation Methods of Propulsion Power for 60 Mts O...
IRJET- Study on Different Estimation Methods of Propulsion Power for 60 Mts O...IRJET- Study on Different Estimation Methods of Propulsion Power for 60 Mts O...
IRJET- Study on Different Estimation Methods of Propulsion Power for 60 Mts O...
 
Automatic-identification system gr1.pptx
Automatic-identification system gr1.pptxAutomatic-identification system gr1.pptx
Automatic-identification system gr1.pptx
 
Optimal routing development based on real voyage data presented by_sewonkim
Optimal  routing  development based on real voyage  data presented by_sewonkimOptimal  routing  development based on real voyage  data presented by_sewonkim
Optimal routing development based on real voyage data presented by_sewonkim
 
DSD-INT 2018 From global to local: Volvo Ocean Race 2018 - Minns
DSD-INT 2018 From global to local: Volvo Ocean Race 2018 - MinnsDSD-INT 2018 From global to local: Volvo Ocean Race 2018 - Minns
DSD-INT 2018 From global to local: Volvo Ocean Race 2018 - Minns
 
Embedding Risk in Everything we do
Embedding Risk in Everything we doEmbedding Risk in Everything we do
Embedding Risk in Everything we do
 
IRJET- Preliminary Design of Floating Dry Dock
IRJET- Preliminary Design of Floating Dry DockIRJET- Preliminary Design of Floating Dry Dock
IRJET- Preliminary Design of Floating Dry Dock
 
Dissemination workshop-v2.1
Dissemination workshop-v2.1Dissemination workshop-v2.1
Dissemination workshop-v2.1
 
2010
 2010 2010
2010
 
Aspng 2016_RTG hydro paper
Aspng 2016_RTG hydro paperAspng 2016_RTG hydro paper
Aspng 2016_RTG hydro paper
 
Container Terminal study
Container Terminal studyContainer Terminal study
Container Terminal study
 
TGS GPS- Post Well Analysis - mid Norway
TGS GPS- Post Well Analysis - mid Norway TGS GPS- Post Well Analysis - mid Norway
TGS GPS- Post Well Analysis - mid Norway
 
Reservoir connectivity analysis_with_streamline_sim_nov_2010_v2
Reservoir connectivity analysis_with_streamline_sim_nov_2010_v2Reservoir connectivity analysis_with_streamline_sim_nov_2010_v2
Reservoir connectivity analysis_with_streamline_sim_nov_2010_v2
 
SELECTION OF DRY PORT LOCATION FOR COSCO SHIPPING LINE GHANA COMPANY LIMITED ...
SELECTION OF DRY PORT LOCATION FOR COSCO SHIPPING LINE GHANA COMPANY LIMITED ...SELECTION OF DRY PORT LOCATION FOR COSCO SHIPPING LINE GHANA COMPANY LIMITED ...
SELECTION OF DRY PORT LOCATION FOR COSCO SHIPPING LINE GHANA COMPANY LIMITED ...
 
REQUEST FOR PROPOSAL PROCEDURES
REQUEST FOR PROPOSAL PROCEDURESREQUEST FOR PROPOSAL PROCEDURES
REQUEST FOR PROPOSAL PROCEDURES
 

Recently uploaded

一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理
一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理
一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理
hyfjgavov
 
一比一原版巴斯大学毕业证(Bath毕业证书)学历如何办理
一比一原版巴斯大学毕业证(Bath毕业证书)学历如何办理一比一原版巴斯大学毕业证(Bath毕业证书)学历如何办理
一比一原版巴斯大学毕业证(Bath毕业证书)学历如何办理
y3i0qsdzb
 
A presentation that explain the Power BI Licensing
A presentation that explain the Power BI LicensingA presentation that explain the Power BI Licensing
A presentation that explain the Power BI Licensing
AlessioFois2
 
一比一原版南十字星大学毕业证(SCU毕业证书)学历如何办理
一比一原版南十字星大学毕业证(SCU毕业证书)学历如何办理一比一原版南十字星大学毕业证(SCU毕业证书)学历如何办理
一比一原版南十字星大学毕业证(SCU毕业证书)学历如何办理
slg6lamcq
 
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
taqyea
 
UofT毕业证如何办理
UofT毕业证如何办理UofT毕业证如何办理
UofT毕业证如何办理
exukyp
 
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
nuttdpt
 
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
sameer shah
 
University of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma TranscriptUniversity of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma Transcript
soxrziqu
 
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
apvysm8
 
一比一原版英属哥伦比亚大学毕业证(UBC毕业证书)学历如何办理
一比一原版英属哥伦比亚大学毕业证(UBC毕业证书)学历如何办理一比一原版英属哥伦比亚大学毕业证(UBC毕业证书)学历如何办理
一比一原版英属哥伦比亚大学毕业证(UBC毕业证书)学历如何办理
z6osjkqvd
 
Build applications with generative AI on Google Cloud
Build applications with generative AI on Google CloudBuild applications with generative AI on Google Cloud
Build applications with generative AI on Google Cloud
Márton Kodok
 
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
wyddcwye1
 
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
nuttdpt
 
Population Growth in Bataan: The effects of population growth around rural pl...
Population Growth in Bataan: The effects of population growth around rural pl...Population Growth in Bataan: The effects of population growth around rural pl...
Population Growth in Bataan: The effects of population growth around rural pl...
Bill641377
 
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docxDATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
SaffaIbrahim1
 
一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理
一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理
一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理
xclpvhuk
 
Palo Alto Cortex XDR presentation .......
Palo Alto Cortex XDR presentation .......Palo Alto Cortex XDR presentation .......
Palo Alto Cortex XDR presentation .......
Sachin Paul
 
End-to-end pipeline agility - Berlin Buzzwords 2024
End-to-end pipeline agility - Berlin Buzzwords 2024End-to-end pipeline agility - Berlin Buzzwords 2024
End-to-end pipeline agility - Berlin Buzzwords 2024
Lars Albertsson
 
一比一原版(UO毕业证)渥太华大学毕业证如何办理
一比一原版(UO毕业证)渥太华大学毕业证如何办理一比一原版(UO毕业证)渥太华大学毕业证如何办理
一比一原版(UO毕业证)渥太华大学毕业证如何办理
aqzctr7x
 

Recently uploaded (20)

一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理
一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理
一比一原版兰加拉学院毕业证(Langara毕业证书)学历如何办理
 
一比一原版巴斯大学毕业证(Bath毕业证书)学历如何办理
一比一原版巴斯大学毕业证(Bath毕业证书)学历如何办理一比一原版巴斯大学毕业证(Bath毕业证书)学历如何办理
一比一原版巴斯大学毕业证(Bath毕业证书)学历如何办理
 
A presentation that explain the Power BI Licensing
A presentation that explain the Power BI LicensingA presentation that explain the Power BI Licensing
A presentation that explain the Power BI Licensing
 
一比一原版南十字星大学毕业证(SCU毕业证书)学历如何办理
一比一原版南十字星大学毕业证(SCU毕业证书)学历如何办理一比一原版南十字星大学毕业证(SCU毕业证书)学历如何办理
一比一原版南十字星大学毕业证(SCU毕业证书)学历如何办理
 
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
一比一原版(harvard毕业证书)哈佛大学毕业证如何办理
 
UofT毕业证如何办理
UofT毕业证如何办理UofT毕业证如何办理
UofT毕业证如何办理
 
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
一比一原版(UCSF文凭证书)旧金山分校毕业证如何办理
 
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
STATATHON: Unleashing the Power of Statistics in a 48-Hour Knowledge Extravag...
 
University of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma TranscriptUniversity of New South Wales degree offer diploma Transcript
University of New South Wales degree offer diploma Transcript
 
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
办(uts毕业证书)悉尼科技大学毕业证学历证书原版一模一样
 
一比一原版英属哥伦比亚大学毕业证(UBC毕业证书)学历如何办理
一比一原版英属哥伦比亚大学毕业证(UBC毕业证书)学历如何办理一比一原版英属哥伦比亚大学毕业证(UBC毕业证书)学历如何办理
一比一原版英属哥伦比亚大学毕业证(UBC毕业证书)学历如何办理
 
Build applications with generative AI on Google Cloud
Build applications with generative AI on Google CloudBuild applications with generative AI on Google Cloud
Build applications with generative AI on Google Cloud
 
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
原版一比一利兹贝克特大学毕业证(LeedsBeckett毕业证书)如何办理
 
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
一比一原版(UCSB文凭证书)圣芭芭拉分校毕业证如何办理
 
Population Growth in Bataan: The effects of population growth around rural pl...
Population Growth in Bataan: The effects of population growth around rural pl...Population Growth in Bataan: The effects of population growth around rural pl...
Population Growth in Bataan: The effects of population growth around rural pl...
 
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docxDATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
DATA COMMS-NETWORKS YR2 lecture 08 NAT & CLOUD.docx
 
一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理
一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理
一比一原版(Unimelb毕业证书)墨尔本大学毕业证如何办理
 
Palo Alto Cortex XDR presentation .......
Palo Alto Cortex XDR presentation .......Palo Alto Cortex XDR presentation .......
Palo Alto Cortex XDR presentation .......
 
End-to-end pipeline agility - Berlin Buzzwords 2024
End-to-end pipeline agility - Berlin Buzzwords 2024End-to-end pipeline agility - Berlin Buzzwords 2024
End-to-end pipeline agility - Berlin Buzzwords 2024
 
一比一原版(UO毕业证)渥太华大学毕业证如何办理
一比一原版(UO毕业证)渥太华大学毕业证如何办理一比一原版(UO毕业证)渥太华大学毕业证如何办理
一比一原版(UO毕业证)渥太华大学毕业证如何办理
 

Bd 2018 ibrahim

  • 1. DATA-DRIVEN VESSEL SERVICE TIME FORECASTING USING LONG SHORT-TERM MEMORY RECURRENT NEURAL NETWORKS Ibrahim AbuAlhaol, Rafael Falcon, Rami Abielmona, and Emil Petriu Project : Big Data Analytics for the Maritime Internet of Things Funding: NSERC CRD 499024-16, Ontario Centres of Excellence (OCE) , Larus Technologies
  • 2. Motivation 12/11/18 2 ‣ Maritime Port congestion causes delay in the shipping services which results in financial and reputation losses. ‣ Disruption management mitigates the impact of disruption events but requires data-driven insights to evaluate the disruption. ‣ Can we model and forecast average Vessel Service Time by using Automatic Identification System (AIS)?
  • 3. Contributions 12/11/18 3 ‣ Spatiotemporal mining algorithms to calculate Convex hull area, Geohash area, and vessels proximity. ‣ Analytical formulation of two Port Congestion Indicators (PCIs) to capture port spatial complexity and spatial density. ‣ AIS-based mining algorithm to estimate average Vessel Service Time. ‣ LSTM-based model to forecast average Vessel Service Time.
  • 4. 12/11/18 4 ‣ Reliable shipping services is an important challenge for maritime port authorities and liner shipping companies. ‣ Regular uncertainties (e.g., port productivity) and disruptions (e.g., weather conditions) are main factors that affect the quality of maritime port services. ‣ Port authorities need to mitigate disruption by considering all possible causes and appropriate countermeasures. ‣ We propose data-driven Port Congestion Indicators (PCIs) and Average Vessel Service Time forecasting model to provide actionable insights to port authority operation managers and other stakeholders (liner shipping companies) ‣ Seaborne trade is estimated to have 90% of the volume of global trade and therefore maritime port performance and resilience is crucial in sustaining global economic growth. Connecting the dots!
  • 5. Data: Automatic Identification System (AIS) 12/11/18 * Draught of a ship’s hull is the vertical distance between the waterline and the bottom of the hull. ‣ AIS is a vessel tracking system that provides regular updates on a vessel’s movement and other relevant ship voyage data to other parties. ‣ Static and Dynamic vessel information can be electronically exchanged between AIS-receiving stations (on board, ashore or satellite). *
  • 6. Big Data characteristic of AIS 12/11/18 6 ‣ Volume: The AIS data is big in volume where one year of Terrestrial data is around 1 Terabyte. ‣ Velocity: AIS dynamic messages are broadcast at different time intervals depending on the vessel’s speed and rate of turn (from 2 seconds to 3 minutes). ‣ Veracity: Some of the fields in an AIS message could be either left outdated or intentionally spoofed. ‣ Variety: AIS messages report different data types (e.g., Destination is text whereas Maritime Mobile Service Identity (MMSI) is an integer).
  • 7. Area of Interest [Port of Singapore] 12/11/18 7 Convex Hull Area Geohash Area
  • 8. 12/11/18 8 Geohash precision and cell height/width ‣ Geohash is a geocoding system encodes a geographic location into a short string of letters and digits. ‣ We used precision-7 (PREC = 7 ) geohashes which divides the Area of Interest into 153m x 153m cells. Geohash Area
  • 9. AIS Data mining Framework 12/11/18 9 The Framework is composed of • Cassandra for the consumption of AIS data, • Spark for mining and extracting, and • TensorFlow for LSTM modeling and forecasting.
  • 10. Spatiotemporal Data Mining 12/11/18 10 ‣ Convex Hull Area (ConvArea): The port convex hull area is defined as the area that encloses all vessels in the smallest perimeter fence. ‣ Geohash Area (GeoArea): Geohash is a geocoding system which encodes a geographic location into a short string of letters and digits. Geohash area with precsion-7 is the sum of all blue squares shown in the figure. Convex hull and precision-7 geohashes for Port of Hong Kong in July 2015 (ShipT ype : 70 - 79, ShipSpeed <= 5 knots, ConvArea = 63.55 Km2 , GeoArea = 4.28 Km2). ‣ Average Vessel Proximity (D ): The average distance between the locations of all vessels that are reported as either “Anchored” or “Moored” and have a speed less than a predefined threshold.
  • 15. Port Congestion Indicators (PCI) [1/2] 12/11/18 15 ‣ Spatial Complexity (SpComplexity): is calculated after mining the convex hull area (ConvArea) and the average vessel proximity (D ) as presented in Algorithm 1 and Algorithm 3. • i is the hour index from all hours (I) in January and February of 2018. • G(i) denotes the number of unique geohashes at the ith aggregation period.
  • 16. Port Congestion Indicators (PCI) [2/2] 12/11/18 16 ‣ Spatial Density (SpDensity) calculated after mining the convex hull area (ConvArea) and the Geohash area (GeoArea) as presented in Algorithm 1 and Algorithm 2. • i is the hour index from all hours (I) in January and February of 2018.
  • 17. Time series visualization with one hour aggregation 12/11/18 17
  • 20. LSTM with dense layer architecture to forecast Average VST 12/11/18 20 ‣ Lag Features: Current and past VST, spatiotemporal characteristics (i.e., ConvArea , GeotoArea , !), and congestion indicators (i.e., SpComplexity and SpDensity ). k = 0; 1; 2; 3; 4 in the current (i.e., k=0) and the past four aggregation periods (k = 4, is selected after trying many possible lags). K=0K=1K=2K=3 K=4
  • 21. Architecture parameters and MSE Performance 12/11/18 21 We ran each experiment 50 times and provided the 95% confidence intervals.
  • 22. 12/11/18 22 LSTM Models Performance with different time granularities
  • 23. Summary and Conclusion 12/11/18 23 ‣ The mined ConvArea and GeoArea were negatively correlated with average VST which aligns with the fact that a larger area reduces the congestion and therefore decreases average VST values. ‣ SpComplexity, SpDensity , and ! were positively correlated with average VST ; this corroborates the fact that smaller values of these congestion indicators lead to low average VST values. ‣ The results provides an empirical evidence of the practicality of using LSTM Recurrent Neural Networks to model and forecast average VST using current/past spatiotemporal characteristics and congestion indicators mined from AIS data.
  • 24. Limitations and Future Work 12/11/18 24 ‣ One necessary extension of this work is to train and validate the models on more AIS data. ‣ Investigate the model on several time and geohash granularities. ‣ The LSTM architecture could be enhanced by adding more layers or/and incorporating more lags. ‣ Investigate advanced LSTM architectures such as § Bi-directional LSTM § Stacked LSTM