SlideShare a Scribd company logo
CONNECT. TRANSFORM. AUTOMATE.
Helping rebuild a City with
FME
Todd Davis
GIS Consultant
The City and Background
!  Christchurch, New Zealand. 2nd biggest city with
400,000 residents (under 10% of NZ population)
!  Hit by 4 large Earthquake in 2010-2011
!  4 September 2010 – 7.1 Magnitude, 1.26 PGA
!  22 February 2011 – 6.3 Magnitude, 2.2 PGA, 185
dead
!  13 June 2011 – 6.3 Magnitude, 2.13 PGA, 1 dead
!  23 December 2011 – 6.0 Magnitude, 1 PGA
CONNECT. TRANSFORM. AUTOMATE.
The Aftermath
!  Liquefaction – large portions of Christchurch land
liquefied causing damage to roads, infrastructure,
housing and land (especially on Eastern side of
city)
!  Over 6000 homes “Red Zoned” (due to land
damage, rock full danger)
!  CBD fenced off for over 2 years
!  Nearly 80% of CBD buildings will be demolished
(nearly all stood through the earthquake)
Images
The Rebuild
!  The move west…business and residential
(gridlock)
!  Expected NZ$40 billion to rebuild
!  3 years on, more buildings still coming down than
going up.
!  Residents want the city fixed NOW.
!  SCIRT (an alliance)- Over NZ$2 billion to fix
horizontal infrastructure…started from scratch
!  150 road crews, currently 40 within CBD
FME at SCIRT
!  20+ organisation supplying all sort of spatial and
non-spatial data (600+ layers on GIS viewer)
!  Location Intelligence meets Business Intelligence
!  Gateway for data in and out of organisation
!  Good/Bad – Expectations and increasing
workload…might be victims of our success.
Proactive use and as a bandaid (sadly)
!  It has become well known in the organisation:
“12d bad, GIS good”
“You guys have the tools to do this, we don’t”
“Can I get this FME on my computer”
Making Config files for Multiple
Roles in GIS Viewer
Config files - 2012
Mainly Python
Config Files - 2014
Featuremerger in 2014 – Suppliers First
Ww, Sw and Ws
!  2d information into 3d (2d pipes with a 2d invert
point somewhere away from the pipes end…
hopefully coincidental (no id linkage))
!  Pipe id deleted, no reference between new and
historic ids
GPS Photos
GPS Photos
Check coordinates, extract date and time, orientation,
resize photos, create thumbnail, add watermark, create
feature, assign description
PDAT
!  Originally designed in excel, a pseudo-regression
analysis to figure out which pipes in an area are
likely to be damaged based on several factors,
without the need to CCTV all pipes.
!  Took a knowledgeable user around one week to
run in excel and hope that is didn’t crash.
!  Recreated in FME and takes under 3 hours with a
standard user running the process
FME Server 1st Process
!  Key requirements:
!  Watch directory for additions
!  Load 6 different excel files into Microsoft sql
!  Archive excel files after loading
!  Send emails of failures, or success and counts
And then:
!  Remove empty rows in excel
!  Unzip zip files containing excel files and process
according to zip file name.
FME Server 1st Process – The
parent
FME Server 1st Process – a
child process
The future in Christchurch
!  FME Server to check construction firm asbuilts
without manual intervention and only minor
intervention once submitted into SCIRT GIS
team(very close)
!  Traffic team, Designers etc running their own test
through FME Server
!  “GIS” processes/setup at SCIRT investigated for
deployment back into local council
Thank You!
!  Questions?
!  For more information:
!  Todd Davis todd.davis@scirt.co.nz or
todd.davis2@Jacobs.com
!  Stronger Christchurch Infrastructure Rebuild Team
!  www.scirt.co.nz
CONNECT. TRANSFORM. AUTOMATE.

More Related Content

Similar to Helping Rebuild a City with FME

Where Do We Put It All? Lessons Learned Housing Large Geospatial Data Collect...
Where Do We Put It All? Lessons Learned Housing Large Geospatial Data Collect...Where Do We Put It All? Lessons Learned Housing Large Geospatial Data Collect...
Where Do We Put It All? Lessons Learned Housing Large Geospatial Data Collect...
nacis_slides
 
Multi-Party Computation in 2029: Boom, Bust, or Bonanza?
Multi-Party Computation in 2029: Boom, Bust, or Bonanza?Multi-Party Computation in 2029: Boom, Bust, or Bonanza?
Multi-Party Computation in 2029: Boom, Bust, or Bonanza?
David Evans
 
The internet of things, do we need all that data?
The internet of things, do we need all that data?The internet of things, do we need all that data?
The internet of things, do we need all that data?
Christian Verstraete
 
DSD-NL 2017 D-HYDRO Suite - the next steps - Melger
DSD-NL 2017 D-HYDRO Suite - the next steps - MelgerDSD-NL 2017 D-HYDRO Suite - the next steps - Melger
DSD-NL 2017 D-HYDRO Suite - the next steps - Melger
Deltares
 
JavaOne Tokyo LT : Internationalization
JavaOne Tokyo LT : InternationalizationJavaOne Tokyo LT : Internationalization
JavaOne Tokyo LT : Internationalization
Takayuki Okazaki
 
FME Spatial Querying in a CAD-Driven GIS
FME Spatial Querying in a CAD-Driven GISFME Spatial Querying in a CAD-Driven GIS
FME Spatial Querying in a CAD-Driven GIS
Safe Software
 
Network Mapping - Esri UK Annual Conference 2016
Network Mapping - Esri UK Annual Conference 2016Network Mapping - Esri UK Annual Conference 2016
Network Mapping - Esri UK Annual Conference 2016
Esri UK
 
Senior Multi-Disciplined CADD Designer 3
Senior Multi-Disciplined CADD Designer 3Senior Multi-Disciplined CADD Designer 3
Senior Multi-Disciplined CADD Designer 3
GARY HILSON
 
OSi Local Gov User Group Presentation
OSi Local Gov User Group PresentationOSi Local Gov User Group Presentation
OSi Local Gov User Group Presentation
IMGS
 
Euskaltel and GIS
Euskaltel and GISEuskaltel and GIS
Euskaltel and GIS
Esri
 
Generalized EOS Data Converter: Making Data Products Accessible to GIS Tools
Generalized EOS Data Converter: Making Data Products Accessible to GIS ToolsGeneralized EOS Data Converter: Making Data Products Accessible to GIS Tools
Generalized EOS Data Converter: Making Data Products Accessible to GIS Tools
The HDF-EOS Tools and Information Center
 
VMC Career Portfolio Aug 15
VMC Career Portfolio Aug 15VMC Career Portfolio Aug 15
VMC Career Portfolio Aug 15
Victor Couto
 
NCAFPM 2012_Using GIS V3CMF
NCAFPM 2012_Using GIS V3CMFNCAFPM 2012_Using GIS V3CMF
NCAFPM 2012_Using GIS V3CMF
Danee McGee
 
COMPARISON OF ANALYSIS AND DESIGN OF REGULAR AND IRREGULAR CONFIGURATION OF M...
COMPARISON OF ANALYSIS AND DESIGN OF REGULAR AND IRREGULAR CONFIGURATION OF M...COMPARISON OF ANALYSIS AND DESIGN OF REGULAR AND IRREGULAR CONFIGURATION OF M...
COMPARISON OF ANALYSIS AND DESIGN OF REGULAR AND IRREGULAR CONFIGURATION OF M...
IRJET Journal
 
CV.HAITHAM AMRA_2017
CV.HAITHAM AMRA_2017CV.HAITHAM AMRA_2017
CV.HAITHAM AMRA_2017
haitham abu amra
 
os2stl
os2stlos2stl
Kevin MacDonald - Anyone can make maps
Kevin MacDonald - Anyone can make mapsKevin MacDonald - Anyone can make maps
Kevin MacDonald - Anyone can make maps
#DevTO
 
EOSDIS Status
EOSDIS StatusEOSDIS Status
Nucor Winning As One
Nucor Winning As OneNucor Winning As One
Nucor Winning As One
Robert Copeland
 
Scbj 070618-cv
Scbj 070618-cvScbj 070618-cv

Similar to Helping Rebuild a City with FME (20)

Where Do We Put It All? Lessons Learned Housing Large Geospatial Data Collect...
Where Do We Put It All? Lessons Learned Housing Large Geospatial Data Collect...Where Do We Put It All? Lessons Learned Housing Large Geospatial Data Collect...
Where Do We Put It All? Lessons Learned Housing Large Geospatial Data Collect...
 
Multi-Party Computation in 2029: Boom, Bust, or Bonanza?
Multi-Party Computation in 2029: Boom, Bust, or Bonanza?Multi-Party Computation in 2029: Boom, Bust, or Bonanza?
Multi-Party Computation in 2029: Boom, Bust, or Bonanza?
 
The internet of things, do we need all that data?
The internet of things, do we need all that data?The internet of things, do we need all that data?
The internet of things, do we need all that data?
 
DSD-NL 2017 D-HYDRO Suite - the next steps - Melger
DSD-NL 2017 D-HYDRO Suite - the next steps - MelgerDSD-NL 2017 D-HYDRO Suite - the next steps - Melger
DSD-NL 2017 D-HYDRO Suite - the next steps - Melger
 
JavaOne Tokyo LT : Internationalization
JavaOne Tokyo LT : InternationalizationJavaOne Tokyo LT : Internationalization
JavaOne Tokyo LT : Internationalization
 
FME Spatial Querying in a CAD-Driven GIS
FME Spatial Querying in a CAD-Driven GISFME Spatial Querying in a CAD-Driven GIS
FME Spatial Querying in a CAD-Driven GIS
 
Network Mapping - Esri UK Annual Conference 2016
Network Mapping - Esri UK Annual Conference 2016Network Mapping - Esri UK Annual Conference 2016
Network Mapping - Esri UK Annual Conference 2016
 
Senior Multi-Disciplined CADD Designer 3
Senior Multi-Disciplined CADD Designer 3Senior Multi-Disciplined CADD Designer 3
Senior Multi-Disciplined CADD Designer 3
 
OSi Local Gov User Group Presentation
OSi Local Gov User Group PresentationOSi Local Gov User Group Presentation
OSi Local Gov User Group Presentation
 
Euskaltel and GIS
Euskaltel and GISEuskaltel and GIS
Euskaltel and GIS
 
Generalized EOS Data Converter: Making Data Products Accessible to GIS Tools
Generalized EOS Data Converter: Making Data Products Accessible to GIS ToolsGeneralized EOS Data Converter: Making Data Products Accessible to GIS Tools
Generalized EOS Data Converter: Making Data Products Accessible to GIS Tools
 
VMC Career Portfolio Aug 15
VMC Career Portfolio Aug 15VMC Career Portfolio Aug 15
VMC Career Portfolio Aug 15
 
NCAFPM 2012_Using GIS V3CMF
NCAFPM 2012_Using GIS V3CMFNCAFPM 2012_Using GIS V3CMF
NCAFPM 2012_Using GIS V3CMF
 
COMPARISON OF ANALYSIS AND DESIGN OF REGULAR AND IRREGULAR CONFIGURATION OF M...
COMPARISON OF ANALYSIS AND DESIGN OF REGULAR AND IRREGULAR CONFIGURATION OF M...COMPARISON OF ANALYSIS AND DESIGN OF REGULAR AND IRREGULAR CONFIGURATION OF M...
COMPARISON OF ANALYSIS AND DESIGN OF REGULAR AND IRREGULAR CONFIGURATION OF M...
 
CV.HAITHAM AMRA_2017
CV.HAITHAM AMRA_2017CV.HAITHAM AMRA_2017
CV.HAITHAM AMRA_2017
 
os2stl
os2stlos2stl
os2stl
 
Kevin MacDonald - Anyone can make maps
Kevin MacDonald - Anyone can make mapsKevin MacDonald - Anyone can make maps
Kevin MacDonald - Anyone can make maps
 
EOSDIS Status
EOSDIS StatusEOSDIS Status
EOSDIS Status
 
Nucor Winning As One
Nucor Winning As OneNucor Winning As One
Nucor Winning As One
 
Scbj 070618-cv
Scbj 070618-cvScbj 070618-cv
Scbj 070618-cv
 

More from Safe Software

Essentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation ParametersEssentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation Parameters
Safe Software
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Safe Software
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
Safe Software
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
Safe Software
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
Safe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
Safe Software
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action:  Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action:  Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
Safe Software
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Safe Software
 
Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsPowering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data Streams
Safe Software
 
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemThe Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data Ecosystem
Safe Software
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Safe Software
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Safe Software
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
Safe Software
 
Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GIS
Safe Software
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriGeospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Safe Software
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Safe Software
 
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologyBreaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Safe Software
 

More from Safe Software (20)

Essentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation ParametersEssentials of Automations: Exploring Attributes & Automation Parameters
Essentials of Automations: Exploring Attributes & Automation Parameters
 
Driving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success StoryDriving Business Innovation: Latest Generative AI Advancements & Success Story
Driving Business Innovation: Latest Generative AI Advancements & Success Story
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
Essentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FMEEssentials of Automations: The Art of Triggers and Actions in FME
Essentials of Automations: The Art of Triggers and Actions in FME
 
Essentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with ParametersEssentials of Automations: Optimizing FME Workflows with Parameters
Essentials of Automations: Optimizing FME Workflows with Parameters
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action:  Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action:  Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Powering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data StreamsPowering Real-Time Decisions with Continuous Data Streams
Powering Real-Time Decisions with Continuous Data Streams
 
The Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data EcosystemThe Critical Role of Spatial Data in Today's Data Ecosystem
The Critical Role of Spatial Data in Today's Data Ecosystem
 
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial DataCloud Revolution: Exploring the New Wave of Serverless Spatial Data
Cloud Revolution: Exploring the New Wave of Serverless Spatial Data
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
The Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and InsightThe Zero-ETL Approach: Enhancing Data Agility and Insight
The Zero-ETL Approach: Enhancing Data Agility and Insight
 
Mastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GISMastering MicroStation DGN: How to Integrate CAD and GIS
Mastering MicroStation DGN: How to Integrate CAD and GIS
 
Geospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & EsriGeospatial Synergy: Amplifying Efficiency with FME & Esri
Geospatial Synergy: Amplifying Efficiency with FME & Esri
 
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdfIntroducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
Introducing the New FME Community Webinar - Feb 21, 2024 (2).pdf
 
Breaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI TechnologyBreaking Barriers & Leveraging the Latest Developments in AI Technology
Breaking Barriers & Leveraging the Latest Developments in AI Technology
 

Recently uploaded

Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
Hiroshi SHIBATA
 
Must Know Postgres Extension for DBA and Developer during Migration
Must Know Postgres Extension for DBA and Developer during MigrationMust Know Postgres Extension for DBA and Developer during Migration
Must Know Postgres Extension for DBA and Developer during Migration
Mydbops
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
Zilliz
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
Jason Packer
 
Session 1 - Intro to Robotic Process Automation.pdf
Session 1 - Intro to Robotic Process Automation.pdfSession 1 - Intro to Robotic Process Automation.pdf
Session 1 - Intro to Robotic Process Automation.pdf
UiPathCommunity
 
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
Jason Yip
 
The Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptxThe Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptx
operationspcvita
 
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
saastr
 
Leveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and StandardsLeveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and Standards
Neo4j
 
PRODUCT LISTING OPTIMIZATION PRESENTATION.pptx
PRODUCT LISTING OPTIMIZATION PRESENTATION.pptxPRODUCT LISTING OPTIMIZATION PRESENTATION.pptx
PRODUCT LISTING OPTIMIZATION PRESENTATION.pptx
christinelarrosa
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
Chart Kalyan
 
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-EfficiencyFreshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
ScyllaDB
 
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
Alex Pruden
 
"Scaling RAG Applications to serve millions of users", Kevin Goedecke
"Scaling RAG Applications to serve millions of users",  Kevin Goedecke"Scaling RAG Applications to serve millions of users",  Kevin Goedecke
"Scaling RAG Applications to serve millions of users", Kevin Goedecke
Fwdays
 
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin..."$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
Fwdays
 
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
Edge AI and Vision Alliance
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
Jakub Marek
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
DanBrown980551
 
AppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSFAppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSF
Ajin Abraham
 
Mutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented ChatbotsMutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented Chatbots
Pablo Gómez Abajo
 

Recently uploaded (20)

Introduction of Cybersecurity with OSS at Code Europe 2024
Introduction of Cybersecurity with OSS  at Code Europe 2024Introduction of Cybersecurity with OSS  at Code Europe 2024
Introduction of Cybersecurity with OSS at Code Europe 2024
 
Must Know Postgres Extension for DBA and Developer during Migration
Must Know Postgres Extension for DBA and Developer during MigrationMust Know Postgres Extension for DBA and Developer during Migration
Must Know Postgres Extension for DBA and Developer during Migration
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
 
Session 1 - Intro to Robotic Process Automation.pdf
Session 1 - Intro to Robotic Process Automation.pdfSession 1 - Intro to Robotic Process Automation.pdf
Session 1 - Intro to Robotic Process Automation.pdf
 
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
[OReilly Superstream] Occupy the Space: A grassroots guide to engineering (an...
 
The Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptxThe Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptx
 
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
 
Leveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and StandardsLeveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and Standards
 
PRODUCT LISTING OPTIMIZATION PRESENTATION.pptx
PRODUCT LISTING OPTIMIZATION PRESENTATION.pptxPRODUCT LISTING OPTIMIZATION PRESENTATION.pptx
PRODUCT LISTING OPTIMIZATION PRESENTATION.pptx
 
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdfHow to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
How to Interpret Trends in the Kalyan Rajdhani Mix Chart.pdf
 
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-EfficiencyFreshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
 
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
zkStudyClub - LatticeFold: A Lattice-based Folding Scheme and its Application...
 
"Scaling RAG Applications to serve millions of users", Kevin Goedecke
"Scaling RAG Applications to serve millions of users",  Kevin Goedecke"Scaling RAG Applications to serve millions of users",  Kevin Goedecke
"Scaling RAG Applications to serve millions of users", Kevin Goedecke
 
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin..."$10 thousand per minute of downtime: architecture, queues, streaming and fin...
"$10 thousand per minute of downtime: architecture, queues, streaming and fin...
 
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
“Temporal Event Neural Networks: A More Efficient Alternative to the Transfor...
 
Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)Main news related to the CCS TSI 2023 (2023/1695)
Main news related to the CCS TSI 2023 (2023/1695)
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
 
AppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSFAppSec PNW: Android and iOS Application Security with MobSF
AppSec PNW: Android and iOS Application Security with MobSF
 
Mutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented ChatbotsMutation Testing for Task-Oriented Chatbots
Mutation Testing for Task-Oriented Chatbots
 

Helping Rebuild a City with FME

  • 1. CONNECT. TRANSFORM. AUTOMATE. Helping rebuild a City with FME Todd Davis GIS Consultant
  • 2. The City and Background !  Christchurch, New Zealand. 2nd biggest city with 400,000 residents (under 10% of NZ population) !  Hit by 4 large Earthquake in 2010-2011 !  4 September 2010 – 7.1 Magnitude, 1.26 PGA !  22 February 2011 – 6.3 Magnitude, 2.2 PGA, 185 dead !  13 June 2011 – 6.3 Magnitude, 2.13 PGA, 1 dead !  23 December 2011 – 6.0 Magnitude, 1 PGA CONNECT. TRANSFORM. AUTOMATE.
  • 3. The Aftermath !  Liquefaction – large portions of Christchurch land liquefied causing damage to roads, infrastructure, housing and land (especially on Eastern side of city) !  Over 6000 homes “Red Zoned” (due to land damage, rock full danger) !  CBD fenced off for over 2 years !  Nearly 80% of CBD buildings will be demolished (nearly all stood through the earthquake)
  • 5.
  • 6.
  • 7.
  • 8. The Rebuild !  The move west…business and residential (gridlock) !  Expected NZ$40 billion to rebuild !  3 years on, more buildings still coming down than going up. !  Residents want the city fixed NOW. !  SCIRT (an alliance)- Over NZ$2 billion to fix horizontal infrastructure…started from scratch !  150 road crews, currently 40 within CBD
  • 9. FME at SCIRT !  20+ organisation supplying all sort of spatial and non-spatial data (600+ layers on GIS viewer) !  Location Intelligence meets Business Intelligence !  Gateway for data in and out of organisation !  Good/Bad – Expectations and increasing workload…might be victims of our success. Proactive use and as a bandaid (sadly) !  It has become well known in the organisation: “12d bad, GIS good” “You guys have the tools to do this, we don’t” “Can I get this FME on my computer”
  • 10. Making Config files for Multiple Roles in GIS Viewer
  • 11. Config files - 2012 Mainly Python
  • 12. Config Files - 2014 Featuremerger in 2014 – Suppliers First
  • 13. Ww, Sw and Ws !  2d information into 3d (2d pipes with a 2d invert point somewhere away from the pipes end… hopefully coincidental (no id linkage)) !  Pipe id deleted, no reference between new and historic ids
  • 15. GPS Photos Check coordinates, extract date and time, orientation, resize photos, create thumbnail, add watermark, create feature, assign description
  • 16. PDAT !  Originally designed in excel, a pseudo-regression analysis to figure out which pipes in an area are likely to be damaged based on several factors, without the need to CCTV all pipes. !  Took a knowledgeable user around one week to run in excel and hope that is didn’t crash. !  Recreated in FME and takes under 3 hours with a standard user running the process
  • 17. FME Server 1st Process !  Key requirements: !  Watch directory for additions !  Load 6 different excel files into Microsoft sql !  Archive excel files after loading !  Send emails of failures, or success and counts And then: !  Remove empty rows in excel !  Unzip zip files containing excel files and process according to zip file name.
  • 18. FME Server 1st Process – The parent
  • 19. FME Server 1st Process – a child process
  • 20. The future in Christchurch !  FME Server to check construction firm asbuilts without manual intervention and only minor intervention once submitted into SCIRT GIS team(very close) !  Traffic team, Designers etc running their own test through FME Server !  “GIS” processes/setup at SCIRT investigated for deployment back into local council
  • 21. Thank You! !  Questions? !  For more information: !  Todd Davis todd.davis@scirt.co.nz or todd.davis2@Jacobs.com !  Stronger Christchurch Infrastructure Rebuild Team !  www.scirt.co.nz CONNECT. TRANSFORM. AUTOMATE.