SlideShare a Scribd company logo
Spatial to Text:
FME Outside of
GIS
By: Patrick Cheng
Objectives
Create models for simulating fluid
in pipelines used in Synergi
Pipeline Simulator [SPS]
● Automate data integration for
pipeline design, optimization,
and leak detection.
● Keep up-to-date with business
demands of using hydraulic
profiling/pressure models.
Challenge
Automate a previously month-long
model creation process.
Solution
FME Workflow
Integrate data and
convert into a text-
based format
SPS
Fully functioning system
GIS spatial data
+
PODS attribute data
START FINISH
B b
Input
FME Workspace
Basic Breakdown: Part 1
Objective:
• Obtain attributes from PODS
database and As-built/ILI generated
pipeline geometry
• Calculate length weighted averages
for attributes such as wall thickness
and operating pressures
• Prepare geometry to be segmented
by lateral (smaller pipelines)
Basic Breakdown: Part 2
Objective:
• Convert spatially projected data
back to a Cartesian coordinate
system
• Apply new adjusted coordinates to
all aspects of the text attribute to be
further used: valves, start mid and
end points of pipeline, facilities.
Basic Breakdown: Part 3
Objective:
• Provide elevation profile that can be
used by SPS
• Combine entire elevation profiles
into one attribute feature (attributes
with over 100 lines of text)
Basic Breakdown: Part 4
Objective:
• Establishing trigger to create a SPS
ready file
• Putting everything in text format into
a basic text file
• SPS takes a specific file type
[.inprep] but in reality is a just a text
file so outputting .txt is renamed to
.inprep
Output
Output
• File can be directly imported
into SPS
• Geometrically similar to real
world placement of assets
• Text formatting allows for cut
and paste into existing
models without modifications
to create much complicated
systems
Output
Results
● A fully automated system that has replace
manual building of models
● File format that can be imported directly into the
software without further modifications
● 1 month of effort has been reduced to 1-2 hours.
Benefits
● Increased standardization and accuracy of
pipeline attributes.
● Automation of model creation.
● Quick turnaround modelling allowing for further
analytics for proposed new builds and new
pipeline to be added to already existing models
● Create models that are visually relatable to real
world placement of assets.
● Time is saved to free up resources and staff
workload.
Tips
● ListBuilder, Sorter, and
Concatenator are helpful for
creating multiline attributes.
● ExpressionEvaluator is helpful
for creating scaling factors.
● StringConcatenator is helpful
for generating script syntax.
Thank you!
Questions?
- Patrick Cheng, Plains Midstream Canada

More Related Content

What's hot

Introduction to Pipe stress analysis
Introduction to Pipe stress analysisIntroduction to Pipe stress analysis
Introduction to Pipe stress analysisSaikrishnaNagumalli
 
Inspection manual for piping
Inspection manual for pipingInspection manual for piping
Inspection manual for pipingKhiem Vo Duy
 
19 nueva tecnología de cementación
19   nueva tecnología de cementación19   nueva tecnología de cementación
19 nueva tecnología de cementaciónAgustÍn Piccione
 
Quality Control & Quality Assurance of MS pipeline
Quality Control & Quality Assurance of MS pipelineQuality Control & Quality Assurance of MS pipeline
Quality Control & Quality Assurance of MS pipelineIEI GSC
 
Computerized Fuel Management System in a Barge
Computerized Fuel Management System in a BargeComputerized Fuel Management System in a Barge
Computerized Fuel Management System in a BargeMd. Moynul Islam
 
ASME Vessels, Pig Launchers, Strainers and More from Sweco Fab
ASME Vessels, Pig Launchers, Strainers and More from Sweco FabASME Vessels, Pig Launchers, Strainers and More from Sweco Fab
ASME Vessels, Pig Launchers, Strainers and More from Sweco FabPiping Technology & Products, Inc.
 
Pipe Flange Manufacturing, Testing ,Inspection and Marking
Pipe Flange Manufacturing, Testing ,Inspection and MarkingPipe Flange Manufacturing, Testing ,Inspection and Marking
Pipe Flange Manufacturing, Testing ,Inspection and MarkingVarun Patel
 
ipec.info | Pfd p&id
ipec.info | Pfd p&idipec.info | Pfd p&id
ipec.info | Pfd p&idIPEC
 
Well Test Analysis in Horizontal Wells
Well Test Analysis in Horizontal WellsWell Test Analysis in Horizontal Wells
Well Test Analysis in Horizontal WellsSohil Shah
 
Operaciones con Tubería flexible
Operaciones con Tubería flexibleOperaciones con Tubería flexible
Operaciones con Tubería flexibleManuel Hernandez
 
Gas Lift Design: Comparative Study of Continuous and Intermittent Gas Lift (C...
Gas Lift Design: Comparative Study of Continuous and Intermittent Gas Lift (C...Gas Lift Design: Comparative Study of Continuous and Intermittent Gas Lift (C...
Gas Lift Design: Comparative Study of Continuous and Intermittent Gas Lift (C...Nicodeme Feuwo
 
Analisis del reservorio
Analisis del reservorioAnalisis del reservorio
Analisis del reservorioCharls Val
 
Cálculos para Operaciones de Perforación, Producción y Reacondicionamiento de...
Cálculos para Operaciones de Perforación, Producción y Reacondicionamiento de...Cálculos para Operaciones de Perforación, Producción y Reacondicionamiento de...
Cálculos para Operaciones de Perforación, Producción y Reacondicionamiento de...Alex Urdaneta
 
TOPIC 3.1 - Flow Measurement.pptx
TOPIC 3.1 - Flow Measurement.pptxTOPIC 3.1 - Flow Measurement.pptx
TOPIC 3.1 - Flow Measurement.pptxQurratuAini76
 
Oil and Natural Gas Corporation Limited
Oil and Natural Gas Corporation LimitedOil and Natural Gas Corporation Limited
Oil and Natural Gas Corporation LimitedDharmik Thummar
 

What's hot (20)

Introduction to Pipe stress analysis
Introduction to Pipe stress analysisIntroduction to Pipe stress analysis
Introduction to Pipe stress analysis
 
04 gas lift_equipment
04 gas lift_equipment04 gas lift_equipment
04 gas lift_equipment
 
Inspection manual for piping
Inspection manual for pipingInspection manual for piping
Inspection manual for piping
 
19 nueva tecnología de cementación
19   nueva tecnología de cementación19   nueva tecnología de cementación
19 nueva tecnología de cementación
 
Quality Control & Quality Assurance of MS pipeline
Quality Control & Quality Assurance of MS pipelineQuality Control & Quality Assurance of MS pipeline
Quality Control & Quality Assurance of MS pipeline
 
Wellhed
WellhedWellhed
Wellhed
 
Computerized Fuel Management System in a Barge
Computerized Fuel Management System in a BargeComputerized Fuel Management System in a Barge
Computerized Fuel Management System in a Barge
 
ASME Vessels, Pig Launchers, Strainers and More from Sweco Fab
ASME Vessels, Pig Launchers, Strainers and More from Sweco FabASME Vessels, Pig Launchers, Strainers and More from Sweco Fab
ASME Vessels, Pig Launchers, Strainers and More from Sweco Fab
 
Pipe Flange Manufacturing, Testing ,Inspection and Marking
Pipe Flange Manufacturing, Testing ,Inspection and MarkingPipe Flange Manufacturing, Testing ,Inspection and Marking
Pipe Flange Manufacturing, Testing ,Inspection and Marking
 
ipec.info | Pfd p&id
ipec.info | Pfd p&idipec.info | Pfd p&id
ipec.info | Pfd p&id
 
Well Test Analysis in Horizontal Wells
Well Test Analysis in Horizontal WellsWell Test Analysis in Horizontal Wells
Well Test Analysis in Horizontal Wells
 
Operaciones con Tubería flexible
Operaciones con Tubería flexibleOperaciones con Tubería flexible
Operaciones con Tubería flexible
 
Pipeline hydraulic calculation
Pipeline hydraulic calculationPipeline hydraulic calculation
Pipeline hydraulic calculation
 
Gas Lift Design: Comparative Study of Continuous and Intermittent Gas Lift (C...
Gas Lift Design: Comparative Study of Continuous and Intermittent Gas Lift (C...Gas Lift Design: Comparative Study of Continuous and Intermittent Gas Lift (C...
Gas Lift Design: Comparative Study of Continuous and Intermittent Gas Lift (C...
 
Well Workover
Well Workover Well Workover
Well Workover
 
Analisis del reservorio
Analisis del reservorioAnalisis del reservorio
Analisis del reservorio
 
Cálculos para Operaciones de Perforación, Producción y Reacondicionamiento de...
Cálculos para Operaciones de Perforación, Producción y Reacondicionamiento de...Cálculos para Operaciones de Perforación, Producción y Reacondicionamiento de...
Cálculos para Operaciones de Perforación, Producción y Reacondicionamiento de...
 
TOPIC 3.1 - Flow Measurement.pptx
TOPIC 3.1 - Flow Measurement.pptxTOPIC 3.1 - Flow Measurement.pptx
TOPIC 3.1 - Flow Measurement.pptx
 
Oil and Natural Gas Corporation Limited
Oil and Natural Gas Corporation LimitedOil and Natural Gas Corporation Limited
Oil and Natural Gas Corporation Limited
 
Introduction to piping design
Introduction to piping designIntroduction to piping design
Introduction to piping design
 

Similar to SDE to SPS (Synergi Pipeline Simulator) - Spatial Data to Text

(ATS3-PLAT08) Optimizing Protocol Performance
(ATS3-PLAT08) Optimizing Protocol Performance(ATS3-PLAT08) Optimizing Protocol Performance
(ATS3-PLAT08) Optimizing Protocol PerformanceBIOVIA
 
Webinar: What's New in Pipeline Pilot 8.5 Collection Update 1?
Webinar: What's New in Pipeline Pilot 8.5 Collection Update 1?Webinar: What's New in Pipeline Pilot 8.5 Collection Update 1?
Webinar: What's New in Pipeline Pilot 8.5 Collection Update 1?BIOVIA
 
AFT Impulse 7 - Ficha de dados
AFT Impulse 7 - Ficha de dadosAFT Impulse 7 - Ficha de dados
AFT Impulse 7 - Ficha de dadosN.A. Tecnologia
 
What's New in SPSS Statistics ?
What's New in SPSS Statistics ? What's New in SPSS Statistics ?
What's New in SPSS Statistics ? Luke Farrell
 
Adopting AnswerModules ModuleSuite
Adopting AnswerModules ModuleSuiteAdopting AnswerModules ModuleSuite
Adopting AnswerModules ModuleSuiteAnswerModules
 
A presentation on forward engineering
A presentation on forward engineeringA presentation on forward engineering
A presentation on forward engineeringGTU
 
Whats new in_ic2018_lvb_approved_v7_final
Whats new in_ic2018_lvb_approved_v7_finalWhats new in_ic2018_lvb_approved_v7_final
Whats new in_ic2018_lvb_approved_v7_finalJurgis 'Jogi' Klaudius
 
[WSO2Con USA 2018] Up-leveling Brownfield Integration
[WSO2Con USA 2018] Up-leveling Brownfield Integration [WSO2Con USA 2018] Up-leveling Brownfield Integration
[WSO2Con USA 2018] Up-leveling Brownfield Integration WSO2
 
Wastewater networks modeling using info works cs
Wastewater networks modeling using info works csWastewater networks modeling using info works cs
Wastewater networks modeling using info works csAHMED NADIM JILANI
 
How to transport PeopleSoft Crystal to BIP via automation_M.... (1).pptx
How to transport PeopleSoft Crystal to BIP via automation_M.... (1).pptxHow to transport PeopleSoft Crystal to BIP via automation_M.... (1).pptx
How to transport PeopleSoft Crystal to BIP via automation_M.... (1).pptxssuser225811
 
Perforce Streams
Perforce StreamsPerforce Streams
Perforce StreamsPerforce
 
Doors_Santosh.S Resume
Doors_Santosh.S ResumeDoors_Santosh.S Resume
Doors_Santosh.S ResumeSantosh Kumar
 

Similar to SDE to SPS (Synergi Pipeline Simulator) - Spatial Data to Text (20)

Vedic Calculator
Vedic CalculatorVedic Calculator
Vedic Calculator
 
(ATS3-PLAT08) Optimizing Protocol Performance
(ATS3-PLAT08) Optimizing Protocol Performance(ATS3-PLAT08) Optimizing Protocol Performance
(ATS3-PLAT08) Optimizing Protocol Performance
 
Webinar: What's New in Pipeline Pilot 8.5 Collection Update 1?
Webinar: What's New in Pipeline Pilot 8.5 Collection Update 1?Webinar: What's New in Pipeline Pilot 8.5 Collection Update 1?
Webinar: What's New in Pipeline Pilot 8.5 Collection Update 1?
 
AFT Impulse 7 - Ficha de dados
AFT Impulse 7 - Ficha de dadosAFT Impulse 7 - Ficha de dados
AFT Impulse 7 - Ficha de dados
 
Resume2015
Resume2015Resume2015
Resume2015
 
What's New in SPSS Statistics ?
What's New in SPSS Statistics ? What's New in SPSS Statistics ?
What's New in SPSS Statistics ?
 
Adopting AnswerModules ModuleSuite
Adopting AnswerModules ModuleSuiteAdopting AnswerModules ModuleSuite
Adopting AnswerModules ModuleSuite
 
A presentation on forward engineering
A presentation on forward engineeringA presentation on forward engineering
A presentation on forward engineering
 
Whats new in_ic2018_lvb_approved_v7_final
Whats new in_ic2018_lvb_approved_v7_finalWhats new in_ic2018_lvb_approved_v7_final
Whats new in_ic2018_lvb_approved_v7_final
 
West Putting Structured Documents to Work
West Putting Structured Documents to WorkWest Putting Structured Documents to Work
West Putting Structured Documents to Work
 
[WSO2Con USA 2018] Up-leveling Brownfield Integration
[WSO2Con USA 2018] Up-leveling Brownfield Integration [WSO2Con USA 2018] Up-leveling Brownfield Integration
[WSO2Con USA 2018] Up-leveling Brownfield Integration
 
Data provenance in Hopsworks
Data provenance in HopsworksData provenance in Hopsworks
Data provenance in Hopsworks
 
Aspen zyqad product_brochure
Aspen zyqad product_brochureAspen zyqad product_brochure
Aspen zyqad product_brochure
 
Wastewater networks modeling using info works cs
Wastewater networks modeling using info works csWastewater networks modeling using info works cs
Wastewater networks modeling using info works cs
 
How to transport PeopleSoft Crystal to BIP via automation_M.... (1).pptx
How to transport PeopleSoft Crystal to BIP via automation_M.... (1).pptxHow to transport PeopleSoft Crystal to BIP via automation_M.... (1).pptx
How to transport PeopleSoft Crystal to BIP via automation_M.... (1).pptx
 
Perforce Streams
Perforce StreamsPerforce Streams
Perforce Streams
 
Doors_Santosh.S Resume
Doors_Santosh.S ResumeDoors_Santosh.S Resume
Doors_Santosh.S Resume
 
Datastage Introduction To Data Warehousing
Datastage Introduction To Data WarehousingDatastage Introduction To Data Warehousing
Datastage Introduction To Data Warehousing
 
Subhabrata Deb Resume
Subhabrata Deb ResumeSubhabrata Deb Resume
Subhabrata Deb Resume
 
Oppd Rug 2012
Oppd Rug 2012Oppd Rug 2012
Oppd Rug 2012
 

More from Safe Software

Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightSafe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action:  Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action:  Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsPowering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsSafe Software
 
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemThe Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemSafe Software
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsSafe Software
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightSafe Software
 
Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISSafe Software
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriGeospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriSafe Software
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfSafe Software
 
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologyBreaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologySafe Software
 
Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Safe Software
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software
 
New Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s FoundersNew Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s FoundersSafe Software
 
Taking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsTaking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsSafe Software
 

More from Safe Software (20)

Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action:  Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action:  Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsPowering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data Streams
 
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemThe Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data Ecosystem
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GIS
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriGeospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & Esri
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
 
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologyBreaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI Technology
 
Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
New Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s FoundersNew Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s Founders
 
Taking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsTaking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New Heights
 

Recently uploaded

UiPath New York Community Day in-person event
UiPath New York Community Day in-person eventUiPath New York Community Day in-person event
UiPath New York Community Day in-person eventDianaGray10
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf91mobiles
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
 
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™UiPathCommunity
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaRTTS
 
КАТЕРИНА АБЗЯТОВА «Ефективне планування тестування ключові аспекти та практ...
КАТЕРИНА АБЗЯТОВА  «Ефективне планування тестування  ключові аспекти та практ...КАТЕРИНА АБЗЯТОВА  «Ефективне планування тестування  ключові аспекти та практ...
КАТЕРИНА АБЗЯТОВА «Ефективне планування тестування ключові аспекти та практ...QADay
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsDorra BARTAGUIZ
 
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlPeter Udo Diehl
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Product School
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...Product School
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform EngineeringJemma Hussein Allen
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
 
Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesBhaskar Mitra
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Alison B. Lowndes
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...Product School
 
ODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupCatarinaPereira64715
 

Recently uploaded (20)

UiPath New York Community Day in-person event
UiPath New York Community Day in-person eventUiPath New York Community Day in-person event
UiPath New York Community Day in-person event
 
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdfFIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
FIDO Alliance Osaka Seminar: Passkeys at Amazon.pdf
 
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdfSmart TV Buyer Insights Survey 2024 by 91mobiles.pdf
Smart TV Buyer Insights Survey 2024 by 91mobiles.pdf
 
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...
 
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024
 
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
Le nuove frontiere dell'AI nell'RPA con UiPath Autopilot™
 
JMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and GrafanaJMeter webinar - integration with InfluxDB and Grafana
JMeter webinar - integration with InfluxDB and Grafana
 
КАТЕРИНА АБЗЯТОВА «Ефективне планування тестування ключові аспекти та практ...
КАТЕРИНА АБЗЯТОВА  «Ефективне планування тестування  ключові аспекти та практ...КАТЕРИНА АБЗЯТОВА  «Ефективне планування тестування  ключові аспекти та практ...
КАТЕРИНА АБЗЯТОВА «Ефективне планування тестування ключові аспекти та практ...
 
Connector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a buttonConnector Corner: Automate dynamic content and events by pushing a button
Connector Corner: Automate dynamic content and events by pushing a button
 
Elevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object CalisthenicsElevating Tactical DDD Patterns Through Object Calisthenics
Elevating Tactical DDD Patterns Through Object Calisthenics
 
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo DiehlFuture Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
Future Visions: Predictions to Guide and Time Tech Innovation, Peter Udo Diehl
 
Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...Designing Great Products: The Power of Design and Leadership by Chief Designe...
Designing Great Products: The Power of Design and Leadership by Chief Designe...
 
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...
 
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
AI for Every Business: Unlocking Your Product's Universal Potential by VP of ...
 
The Future of Platform Engineering
The Future of Platform EngineeringThe Future of Platform Engineering
The Future of Platform Engineering
 
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...
 
Search and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical FuturesSearch and Society: Reimagining Information Access for Radical Futures
Search and Society: Reimagining Information Access for Radical Futures
 
Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........Bits & Pixels using AI for Good.........
Bits & Pixels using AI for Good.........
 
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
From Siloed Products to Connected Ecosystem: Building a Sustainable and Scala...
 
ODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User GroupODC, Data Fabric and Architecture User Group
ODC, Data Fabric and Architecture User Group
 

SDE to SPS (Synergi Pipeline Simulator) - Spatial Data to Text

  • 1. Spatial to Text: FME Outside of GIS By: Patrick Cheng
  • 2. Objectives Create models for simulating fluid in pipelines used in Synergi Pipeline Simulator [SPS] ● Automate data integration for pipeline design, optimization, and leak detection. ● Keep up-to-date with business demands of using hydraulic profiling/pressure models.
  • 3. Challenge Automate a previously month-long model creation process.
  • 4. Solution FME Workflow Integrate data and convert into a text- based format SPS Fully functioning system GIS spatial data + PODS attribute data START FINISH
  • 7. Basic Breakdown: Part 1 Objective: • Obtain attributes from PODS database and As-built/ILI generated pipeline geometry • Calculate length weighted averages for attributes such as wall thickness and operating pressures • Prepare geometry to be segmented by lateral (smaller pipelines)
  • 8. Basic Breakdown: Part 2 Objective: • Convert spatially projected data back to a Cartesian coordinate system • Apply new adjusted coordinates to all aspects of the text attribute to be further used: valves, start mid and end points of pipeline, facilities.
  • 9. Basic Breakdown: Part 3 Objective: • Provide elevation profile that can be used by SPS • Combine entire elevation profiles into one attribute feature (attributes with over 100 lines of text)
  • 10. Basic Breakdown: Part 4 Objective: • Establishing trigger to create a SPS ready file • Putting everything in text format into a basic text file • SPS takes a specific file type [.inprep] but in reality is a just a text file so outputting .txt is renamed to .inprep
  • 12. Output • File can be directly imported into SPS • Geometrically similar to real world placement of assets • Text formatting allows for cut and paste into existing models without modifications to create much complicated systems
  • 14. Results ● A fully automated system that has replace manual building of models ● File format that can be imported directly into the software without further modifications ● 1 month of effort has been reduced to 1-2 hours.
  • 15. Benefits ● Increased standardization and accuracy of pipeline attributes. ● Automation of model creation. ● Quick turnaround modelling allowing for further analytics for proposed new builds and new pipeline to be added to already existing models ● Create models that are visually relatable to real world placement of assets. ● Time is saved to free up resources and staff workload.
  • 16. Tips ● ListBuilder, Sorter, and Concatenator are helpful for creating multiline attributes. ● ExpressionEvaluator is helpful for creating scaling factors. ● StringConcatenator is helpful for generating script syntax.
  • 17. Thank you! Questions? - Patrick Cheng, Plains Midstream Canada

Editor's Notes

  1. The engineering team at PMC was struggling to keep up with the business demands of using hydraulic profiling and pressure models for debottlenecking and ideal pressure design for pipeline systems, which were needed for pipeline design, optimization, and leak detection. Patrick’s team was creating models for use in a program that simulates fluid hydraulics, essentially simulating that there’s a product flowing through a pipeline. In terms of leak detection, the program runs based on operating pressure of their pipelines - information they keep in their database - and if the model runs and does not follow their current operating pressures, they further investigate. The program is primarily used for assigning pressures and pipeline safety. To create these models, the team would extract data from their Pipeline Open Data Standard (PODS) database and convert it into text. These models were each taking 1-2 months to create, so Patrick was tasked with automating the process.
  2. That month-long process used an engineering application called Synergi Pipeline Simulator (SPS). The models generated by this program were structured in a text-based format called an INPREP file; these tracked the user’s feature creation such as pipelines, valves, and pump stations on a planar canvas. These files could be created visually in the SPS application itself or created via text, and required users to not only input the spatial component but the attributes of each module. Caption for the photo: “SPS provides hydraulic profiles for both transient and steady state pipeline operation. The model configuration is flexible to allow changes in pipe geometry allowing various case studies to be performed.”
  3. Patrick replaced this manual process by creating an FME workflow that automatically combines data from their attribute-rich PODS database with spatial data from their GIS, and converts it into the text-based format that is required by SPS.
  4. Here is an example of their input: spatial data in ArcGIS
  5. This is Patrick’s workspace
  6. This is Patrick’s workspace
  7. This is Patrick’s workspace
  8. This is Patrick’s workspace
  9. This is Patrick’s workspace
  10. And this is a sample of the output text file. The data placed into these text files includes pipeline specifications, on line facilities (valves, pumps, outlets) as well as a dynamically generated elevation profile for each line.
  11. And this is a sample of the output text file. The data placed into these text files includes pipeline specifications, on line facilities (valves, pumps, outlets) as well as a dynamically generated elevation profile for each line.
  12. This is an example graph of how the actual models are used. This graph shows pressure, flow rate and batches along the pipeline length.
  13. With some adjustments and slight modifications, the accuracy and standardization of the placement of pipelines and their attributes is more accurate than it was before. Patrick’s team agreed that the reliability towards leveraging Plains Midstream’s PODS database has been a great benefit and saved them from having to draw out attribute and data manually. Now that FME is in place, the hydraulic engineering team only have to wait about 1 - 2 hours, depending on the complexity of the pipelines that need to be joined together, to create a functioning system vs. a model that could have taken over a month to complete.
  14. And once the skeleton model has been generated, the engineer’s only job now is inserting fluid dynamics information and the actual analytical portion of the task instead of having the burden of creating a new model from scratch each time new assets are required for hydraulic modeling. Also a great value addition to this project was to leverage their PODS database to help populate the attributes of the pipeline where the data has ensured accuracy.
  15. The ListBuilder, Sorter, and Concaternator were used to create multiline attributes (thousands of lines in one attribute to create an elevation profile). ExpressionEvaluators enabled Patrick to create scaling factors. The StringConcatenator was used to mimic the script syntax and create a repeatable step to ensure future models would not fall victim to simple syntax error causing failure of the models.
  16. Patrick had previously viewed FME as a tool used to manipulate spatial and tabular data but with this project, Patrick saw a much greater scope of functionality for FME that’s not as limited. He says “This task has felt like I was programming for another language and this was an application that was a guide for it.”