SlideShare a Scribd company logo
1 of 22
Download to read offline
CONNECT. TRANSFORM. AUTOMATE.
ETL GISSUB
Alessandro da Silva
Civil Engineer and GIS Analyst
Summary
1.  ABOUT PETROBRAS
2.  WHAT DOES GEODESY DEPARTMENT DO?
3.  SGO
4.  ETL
5.  GISSUB
6.  IN PROGRESS
7.  QUESTIONS
CONNECT. TRANSFORM. AUTOMATE.
PETROBRAS
PETROBRAS
EXPLORATION AND
PRODUCTION
E&P SERVICES
SUBSEA SERVICES
UNIT
GEODESY DIVISION
!  PETROBRAS in numbers:
•  5th biggest energy company in the world;
•  Daily Production: 2.021.000 barrels/day +/- 2%;
•  Frota de navios : 242 (56 da Petrobras);
•  Dutos: 30.067km (rígidos e flexíveis);
•  15 Refineries and 27 plants;
•  We are at 28 countries;
•  90% of production is from subsea wells.
•  12 Vessels installing pipelines 24/7.
GEODESY DEPARTMENT
Positioning
Mapping
SGO
!  SGO is a system developed to process, store and
share data related to subsea pipelines,
equipments and platforms installed by Petrobras.
!  Used for planing and safe execution of all offshore
operations, avoiding accidents in facilities and
reflexes for people and enviroment.
!  Is CAD based – Started in 1995 (MicroStation).
!  18.500 access in May 2014.
!  Users in more than 300 vessels.
670m
ETL
!  Why ETL?
•  Create GIS tools in CAD (Queries, Searchs,
Attributes, Topology...) is an arduous task;
•  Keep a CAD based structure updated every day (44
dgn files in Campos Basin – 8 professionals);
•  Backup in DVDs;
•  More than one UTM zone;
•  Build a structure to GIS systems;
•  Data Validation (Geometry, Topology, attributes);
•  Interoperability;
•  Good data to build good solutions;
•  Have more than visualization.
ETL
!  What does the ETL do?
•  Extracts data from CAD;
•  Transform them, doing all validations and creating
geometries according to each element behavior;
•  Loads them into a customized APDM (ArcGIS
Pipeline Data Model – World Standar) Oracle
Spatial Database.
ETL
ETL
!  Requirements
•  Treat each element (46) separately according to
the engineering and connectivity rules (Anchors,
Anchor Lines, Pipelines, Platforms, WCTs,
Manifolds, Connectors...);
•  Treat Cell elements;
•  Improve security;
•  Remove Microlines;
•  Update the Database every day;
•  Leave nothing behind;
•  Keep removed features (history);
•  Report the errors.
ETL
!  Around 130 rules;
!  Some Rules:
•  A regular Anchor connects to an Anchor Line;
•  A regular connector is suppose to have at least two
pieces of pipelines;
•  A WCT has always to be in a well head;
•  A PLET always connects a steel pipeline to a flexible
one;
•  There are no lines with less than 1 meter of length;
•  Cathodic Protection, in SGO, just in steel pipelines.
ETL
DGN TO FFS - Workbench
Takes 90 minutes to run
ETL
DGN TO FFS
Workbench
ETL
Anchor - Workbench
Takes 10 minutes to run
ETL
Pipeline - Workbench
Takes 49 minutes to run
GISSUB
IN PROGRESS
!  Geometric Network
IN PROGRESS
!  Connection among elements – Geometric
Network
IN PROGRESS
!  Connecting other databases
IN PROGRESS
!  FME SERVER
Thank You!
!  Questions?
!  For more information:
!  Alessandro da Silva
ale.silva.fototerra@petrobras.com.br
!  Fototerra/Petrobras
CONNECT. TRANSFORM. AUTOMATE.

More Related Content

Similar to ETL GISSUB: Connecting, Transforming and Automating Subsea Infrastructure Data

CIGREAUB5SEAPAC2015PPT68_AU_Haines-revised
CIGREAUB5SEAPAC2015PPT68_AU_Haines-revisedCIGREAUB5SEAPAC2015PPT68_AU_Haines-revised
CIGREAUB5SEAPAC2015PPT68_AU_Haines-revisedBen Haines
 
Interchangeable skids provide plug and-play capabilities, improve uptime
Interchangeable skids provide plug and-play capabilities, improve uptimeInterchangeable skids provide plug and-play capabilities, improve uptime
Interchangeable skids provide plug and-play capabilities, improve uptimeIntelligentManufacturingInstitute
 
POLYTEDA PowerDRC/LVS overview
POLYTEDA PowerDRC/LVS overviewPOLYTEDA PowerDRC/LVS overview
POLYTEDA PowerDRC/LVS overviewAlexander Grudanov
 
Remote Handling Activities and Overview
Remote Handling Activities and OverviewRemote Handling Activities and Overview
Remote Handling Activities and OverviewElena V. Rosa Adame
 
Scada For G Mgt
Scada For G MgtScada For G Mgt
Scada For G MgtAnil Patil
 
Rahul N Deshmukh, Asst. Prof, E&TC Dept, SSBT COET Bambhori Jalgaon, Internat...
Rahul N Deshmukh, Asst. Prof, E&TC Dept, SSBT COET Bambhori Jalgaon, Internat...Rahul N Deshmukh, Asst. Prof, E&TC Dept, SSBT COET Bambhori Jalgaon, Internat...
Rahul N Deshmukh, Asst. Prof, E&TC Dept, SSBT COET Bambhori Jalgaon, Internat...SSBT's C.O.E.T., Bambhori, Jalgaon
 
Christo Kutrovsky - Maximize Data Warehouse Performance with Parallel Queries
Christo Kutrovsky - Maximize Data Warehouse Performance with Parallel QueriesChristo Kutrovsky - Maximize Data Warehouse Performance with Parallel Queries
Christo Kutrovsky - Maximize Data Warehouse Performance with Parallel QueriesChristo Kutrovsky
 
Rapid Control Prototyping Solutions
Rapid Control Prototyping SolutionsRapid Control Prototyping Solutions
Rapid Control Prototyping SolutionsOPAL-RT TECHNOLOGIES
 
Nick Vasiliu Resume Electrical Design Engineer 2017
Nick Vasiliu Resume Electrical Design Engineer 2017Nick Vasiliu Resume Electrical Design Engineer 2017
Nick Vasiliu Resume Electrical Design Engineer 2017Nicolae Vasiliu
 
Advantech Intelligent Communication Gateways are ARM-based robust platforms w...
Advantech Intelligent Communication Gateways are ARM-based robust platforms w...Advantech Intelligent Communication Gateways are ARM-based robust platforms w...
Advantech Intelligent Communication Gateways are ARM-based robust platforms w...samveed
 
ハイブリッドLoRa-BLEモジュールとTTN対応キャリアグレードLoRaWANゲートウェイの紹介
ハイブリッドLoRa-BLEモジュールとTTN対応キャリアグレードLoRaWANゲートウェイの紹介ハイブリッドLoRa-BLEモジュールとTTN対応キャリアグレードLoRaWANゲートウェイの紹介
ハイブリッドLoRa-BLEモジュールとTTN対応キャリアグレードLoRaWANゲートウェイの紹介ShinsukeAiki1
 
Saurabh Singh - CV.DOC
Saurabh Singh - CV.DOCSaurabh Singh - CV.DOC
Saurabh Singh - CV.DOCsaurabh singh
 
RLE Technologies | How Leak Detection Can Minimize Catastrophes
RLE Technologies | How Leak Detection Can Minimize CatastrophesRLE Technologies | How Leak Detection Can Minimize Catastrophes
RLE Technologies | How Leak Detection Can Minimize CatastrophesCochrane_Supply
 
Short.course.introduction.to.vhdl for beginners
Short.course.introduction.to.vhdl for beginners Short.course.introduction.to.vhdl for beginners
Short.course.introduction.to.vhdl for beginners Ravi Sony
 
AgileSwitch SiC Product Overview
AgileSwitch SiC Product OverviewAgileSwitch SiC Product Overview
AgileSwitch SiC Product OverviewJames Charlton
 
The Data Center and Hadoop
The Data Center and HadoopThe Data Center and Hadoop
The Data Center and HadoopDataWorks Summit
 

Similar to ETL GISSUB: Connecting, Transforming and Automating Subsea Infrastructure Data (20)

CIGREAUB5SEAPAC2015PPT68_AU_Haines-revised
CIGREAUB5SEAPAC2015PPT68_AU_Haines-revisedCIGREAUB5SEAPAC2015PPT68_AU_Haines-revised
CIGREAUB5SEAPAC2015PPT68_AU_Haines-revised
 
Interchangeable skids provide plug and-play capabilities, improve uptime
Interchangeable skids provide plug and-play capabilities, improve uptimeInterchangeable skids provide plug and-play capabilities, improve uptime
Interchangeable skids provide plug and-play capabilities, improve uptime
 
6600ingles
6600ingles6600ingles
6600ingles
 
Bathymetry ME Thesis
Bathymetry ME ThesisBathymetry ME Thesis
Bathymetry ME Thesis
 
POLYTEDA PowerDRC/LVS overview
POLYTEDA PowerDRC/LVS overviewPOLYTEDA PowerDRC/LVS overview
POLYTEDA PowerDRC/LVS overview
 
Remote Handling Activities and Overview
Remote Handling Activities and OverviewRemote Handling Activities and Overview
Remote Handling Activities and Overview
 
Scada For G Mgt
Scada For G MgtScada For G Mgt
Scada For G Mgt
 
Rahul N Deshmukh, Asst. Prof, E&TC Dept, SSBT COET Bambhori Jalgaon, Internat...
Rahul N Deshmukh, Asst. Prof, E&TC Dept, SSBT COET Bambhori Jalgaon, Internat...Rahul N Deshmukh, Asst. Prof, E&TC Dept, SSBT COET Bambhori Jalgaon, Internat...
Rahul N Deshmukh, Asst. Prof, E&TC Dept, SSBT COET Bambhori Jalgaon, Internat...
 
Christo Kutrovsky - Maximize Data Warehouse Performance with Parallel Queries
Christo Kutrovsky - Maximize Data Warehouse Performance with Parallel QueriesChristo Kutrovsky - Maximize Data Warehouse Performance with Parallel Queries
Christo Kutrovsky - Maximize Data Warehouse Performance with Parallel Queries
 
Rapid Control Prototyping Solutions
Rapid Control Prototyping SolutionsRapid Control Prototyping Solutions
Rapid Control Prototyping Solutions
 
Nick Vasiliu Resume Electrical Design Engineer 2017
Nick Vasiliu Resume Electrical Design Engineer 2017Nick Vasiliu Resume Electrical Design Engineer 2017
Nick Vasiliu Resume Electrical Design Engineer 2017
 
Advantech Intelligent Communication Gateways are ARM-based robust platforms w...
Advantech Intelligent Communication Gateways are ARM-based robust platforms w...Advantech Intelligent Communication Gateways are ARM-based robust platforms w...
Advantech Intelligent Communication Gateways are ARM-based robust platforms w...
 
Corralling Big Data at TACC
Corralling Big Data at TACCCorralling Big Data at TACC
Corralling Big Data at TACC
 
ハイブリッドLoRa-BLEモジュールとTTN対応キャリアグレードLoRaWANゲートウェイの紹介
ハイブリッドLoRa-BLEモジュールとTTN対応キャリアグレードLoRaWANゲートウェイの紹介ハイブリッドLoRa-BLEモジュールとTTN対応キャリアグレードLoRaWANゲートウェイの紹介
ハイブリッドLoRa-BLEモジュールとTTN対応キャリアグレードLoRaWANゲートウェイの紹介
 
Saurabh Singh - CV.DOC
Saurabh Singh - CV.DOCSaurabh Singh - CV.DOC
Saurabh Singh - CV.DOC
 
RLE Technologies | How Leak Detection Can Minimize Catastrophes
RLE Technologies | How Leak Detection Can Minimize CatastrophesRLE Technologies | How Leak Detection Can Minimize Catastrophes
RLE Technologies | How Leak Detection Can Minimize Catastrophes
 
Short.course.introduction.to.vhdl for beginners
Short.course.introduction.to.vhdl for beginners Short.course.introduction.to.vhdl for beginners
Short.course.introduction.to.vhdl for beginners
 
sairam_CV
sairam_CVsairam_CV
sairam_CV
 
AgileSwitch SiC Product Overview
AgileSwitch SiC Product OverviewAgileSwitch SiC Product Overview
AgileSwitch SiC Product Overview
 
The Data Center and Hadoop
The Data Center and HadoopThe Data Center and Hadoop
The Data Center and Hadoop
 

More from Safe Software

From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action:  Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action:  Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsPowering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsSafe Software
 
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemThe Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemSafe Software
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsSafe Software
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightSafe Software
 
Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISSafe Software
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriGeospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriSafe Software
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfSafe Software
 
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologyBreaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologySafe Software
 
Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Safe Software
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataSafe Software
 
New Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s FoundersNew Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s FoundersSafe Software
 
Taking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsTaking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsSafe Software
 
Initiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategyInitiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategySafe Software
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Safe Software
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...Safe Software
 
Mastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FMEMastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FMESafe Software
 

More from Safe Software (20)

From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action:  Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action:  Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsPowering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data Streams
 
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemThe Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data Ecosystem
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GIS
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriGeospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & Esri
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
 
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologyBreaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI Technology
 
Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...Best Practices to Navigating Data and Application Integration for the Enterpr...
Best Practices to Navigating Data and Application Integration for the Enterpr...
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
New Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s FoundersNew Year's Fireside Chat with Safe Software’s Founders
New Year's Fireside Chat with Safe Software’s Founders
 
Taking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New HeightsTaking Off with FME: Elevating Airport Operations to New Heights
Taking Off with FME: Elevating Airport Operations to New Heights
 
Initiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance StrategyInitiating and Advancing Your Strategic GIS Governance Strategy
Initiating and Advancing Your Strategic GIS Governance Strategy
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
Geospatial Synergy: Amplifying Efficiency with FME & Esri ft. Peak Guest Spea...
 
Mastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FMEMastering DevOps-Driven Data Integration with FME
Mastering DevOps-Driven Data Integration with FME
 

Recently uploaded

Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...shyamraj55
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...gurkirankumar98700
 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGSujit Pal
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 

Recently uploaded (20)

Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
Automating Business Process via MuleSoft Composer | Bangalore MuleSoft Meetup...
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAG
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 

ETL GISSUB: Connecting, Transforming and Automating Subsea Infrastructure Data

  • 1. CONNECT. TRANSFORM. AUTOMATE. ETL GISSUB Alessandro da Silva Civil Engineer and GIS Analyst
  • 2. Summary 1.  ABOUT PETROBRAS 2.  WHAT DOES GEODESY DEPARTMENT DO? 3.  SGO 4.  ETL 5.  GISSUB 6.  IN PROGRESS 7.  QUESTIONS CONNECT. TRANSFORM. AUTOMATE.
  • 3. PETROBRAS PETROBRAS EXPLORATION AND PRODUCTION E&P SERVICES SUBSEA SERVICES UNIT GEODESY DIVISION !  PETROBRAS in numbers: •  5th biggest energy company in the world; •  Daily Production: 2.021.000 barrels/day +/- 2%; •  Frota de navios : 242 (56 da Petrobras); •  Dutos: 30.067km (rígidos e flexíveis); •  15 Refineries and 27 plants; •  We are at 28 countries; •  90% of production is from subsea wells. •  12 Vessels installing pipelines 24/7.
  • 5. SGO !  SGO is a system developed to process, store and share data related to subsea pipelines, equipments and platforms installed by Petrobras. !  Used for planing and safe execution of all offshore operations, avoiding accidents in facilities and reflexes for people and enviroment. !  Is CAD based – Started in 1995 (MicroStation). !  18.500 access in May 2014. !  Users in more than 300 vessels.
  • 6.
  • 8. ETL !  Why ETL? •  Create GIS tools in CAD (Queries, Searchs, Attributes, Topology...) is an arduous task; •  Keep a CAD based structure updated every day (44 dgn files in Campos Basin – 8 professionals); •  Backup in DVDs; •  More than one UTM zone; •  Build a structure to GIS systems; •  Data Validation (Geometry, Topology, attributes); •  Interoperability; •  Good data to build good solutions; •  Have more than visualization.
  • 9. ETL !  What does the ETL do? •  Extracts data from CAD; •  Transform them, doing all validations and creating geometries according to each element behavior; •  Loads them into a customized APDM (ArcGIS Pipeline Data Model – World Standar) Oracle Spatial Database.
  • 10. ETL
  • 11. ETL !  Requirements •  Treat each element (46) separately according to the engineering and connectivity rules (Anchors, Anchor Lines, Pipelines, Platforms, WCTs, Manifolds, Connectors...); •  Treat Cell elements; •  Improve security; •  Remove Microlines; •  Update the Database every day; •  Leave nothing behind; •  Keep removed features (history); •  Report the errors.
  • 12. ETL !  Around 130 rules; !  Some Rules: •  A regular Anchor connects to an Anchor Line; •  A regular connector is suppose to have at least two pieces of pipelines; •  A WCT has always to be in a well head; •  A PLET always connects a steel pipeline to a flexible one; •  There are no lines with less than 1 meter of length; •  Cathodic Protection, in SGO, just in steel pipelines.
  • 13. ETL DGN TO FFS - Workbench Takes 90 minutes to run
  • 15. ETL Anchor - Workbench Takes 10 minutes to run
  • 16. ETL Pipeline - Workbench Takes 49 minutes to run
  • 19. IN PROGRESS !  Connection among elements – Geometric Network
  • 20. IN PROGRESS !  Connecting other databases
  • 22. Thank You! !  Questions? !  For more information: !  Alessandro da Silva ale.silva.fototerra@petrobras.com.br !  Fototerra/Petrobras CONNECT. TRANSFORM. AUTOMATE.